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COMPLETION-TEST LANGUAGE SCALES 

I 

INTRODUCTION 

This monograph is the report of an attempt to derive one or 
more scales for the measurement of ability along certain lines 
closely related to language. No attempt has been made to 
define "language** in any strict sense, and it is entirely possible 
that some persons may be able to speak the English language and 
perhaps to write it fairly well without being able to make a very 
high score on these scales. It may also happen that some indi- 
viduals will be found who score well on these language scales and 
are yet unable to quote a single rule of English grammar. On 
the whole, however, it will be found that ability to complete 
these sentences successfully is very closely related to what is 
usually called ''language ability." 

Professor H. Ebbinghaus,^ who invented the completion-test 
method, characterized it as ''a real test of intelligence. *' It has 
been variously classified by psychologists, as a test of ''imagina- 
tion, " as an " association test, " as a test of "memory, " and as a 
test of numerous other "faculties.** As a matter of fact, the 
completion of incomplete sentences correlates remarkably well 
with almost any other measure of desirable qualities. It would 
perhaps have been just as descriptive to have used the classifica- 
tion "general stand-out-ish-ness" suggested by Professor Hol- 
lingworth;^ but the obvious dependence of the ability to complete 
sentences upon the ability to read and think about printed words, 
and the magnitude of the correlations obtained between the 
completion test and other tests of language ability seemed to 
justify the classification of the completion-test scales for educa- 
tional purposes as "language scales.** 

\ H. Ebbinghaus: Ueber eine neue Methode zur Prilfuns eeistiger F&hi^- 
keiten und inre Anwendung bei Schulkindem. Zeitschrift Jur Psychology, 
Vol. 13 (1897); pp. 401-459. 

' H. L. HoUingworth and others: An Experimental Study of Self- Analysis, 
Estimates of Associates, and the Results of Tests. School and Society, Vol. 

n (1915). pp. 171-179. 



2 Completion-Test Language Scales 

One of the difficulties with the completion test has been that 
it was almost impossible to measure progress with it, because of 
the impossibility of finding two paragraphs of exactly the same 
difficulty. The story of a paragraph does not pass out of one's 
mind completely, and it is therefore not quite fair to say that 
better completion of the same paragraph at the second trial 
means improvement in ability. The scales presented in this 
study are made up of sentences dealing with a wide variety of 
subjects, none of which are very interesting in themselves, and as 
a rule they are forgotten comparatively soon. Because of this 
variety of subject matter and the careful gradation of the sen- 
tences, it will be possible to use the same scale upon the same 
children, after allowing a year or more for them to forget about 
it, without greatly invalidating the results. This will not be 
necessary, however, for Scales B, C, D, and E are for all practical 
purposes equal and interchangeable. Scales J and K are fairly 
well matched, and likewise Scales L and M differ very little in 
their difficulty. 

Having the tests arranged as steps on a scale with approxi- 
mately equal intervals between the steps offers several advan- 
tages over the paragraph-completion method. The individual 
being tested is not discouraged by having a task set for him which 
is beyond his powers, nor is he disgusted at having to do child's 
play. The first sentences are easy enough to encourage the 
youngest child who can read them, and the last sentences are 
hard enough to require thought of well trained persons. With 
these smaller sentence units it is also possible to get a more 
accurate judgment as to the quality of an individual's perform- 
ance, and the comparison of two such performances is much more 
valid. It is very much easier and more accurate to judge that a 
sentence is ''right," "almost right," or "wrong" than it is to 
judge that a paragraph is 20 per cent, 35 per cent, or 70 per cent 
"right." The average teacher finds it almost impossible to 
assign paragraph-completion scores which are quite comparable 
to the scores that a trained psychologist would assign to the 
same paragraphs. Very few teachers will be found, however, 
who can not use the scales proposed in this monograph and, with 
the assistance of the suggested scheme for scoring given in the 
Appendix, secure results which may be compared directly with 
the results obtained by other teachers in other school systems. 
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Allowing the same amount of time to all pupils, and giving 
each pupil two credits for each sentence perfectly completed and 
one credit for each sentence almost perfectly completed, auto- 
matically takes account of the time spent upon the work, the 
quality of the work done, and the difficulty of the tests one is 
able to do. An elaborate system of weighting might be used, 
but the results would probably be no more accurate than those 
obtained by this simple method of scoring. The consecutive 
tests are so well graded that (except in Scale A, the use of which 
the writer does not recommend) there is only one chance out of 
four that any individual will complete a more difficult sentence 
without being able to complete those which precede it. If 
individual X can complete three sentences, individual Y four 
sentences, and Z five sentences on Scale D in the seven minutes 
allowed, we may feel fairly confident that X can complete the^"^ 
first three, Y the first four and Z the first five sentences, and that 
in ability to complete the sentences of Scale D, Z is as much 
better than Y as Y is better than X. In other words, with equal 
distances between steps, the same number of points score may 
be assigned for each step taken, without distorting the facts, for 
the score is cumulative. 



II 

LANGUAGE SCALE A 

I. History of Its Derivation 

During April, May, and June, 19 14, the writer tested 855 
pupils in two public schools of New York City with a "prelim- 
inary list" of fifty-six completion-test sentences. The results 
obtained indicated that a few of the sentences of this preliminary 
list were so constructed as to have little value as completion 
tests for children, and that, after rearranging the sentences in the 
order of their difficulty, there were a few places in the list where 
gaps occurred between consecutive sentences. 

By throwing aside the poorly constructed sentences of the 
preliminary list, arranging the remainder according to their 
difficulty for the 855 children who had tried them, and attempt- 
ing to write other sentences to fill the gaps found in the prelimi- 
nary list, a second list of fifty-six sentences was prepared. This 
second list of fifty-six completion-test sentences will be referred 
to in this monograph as "The Graded Series.*'^ 

With the Graded Series of tests the writer tested, during the 
last two months of 1914 and the first month of 1915, over five 
thousand children in the public schools of New York and New 
Jersey. On the basis of these results, two sentences of the 
Graded Series were selected for each school grade, the two being 
selected for each grade which had proved to be just difficult 
enough to be done by about 50 per cent of the children in that 
grade. This list of twenty-four selected completion tests has for 
convenience been called "Language Scale A."* Scale A there- 
fore contains two second grade sentences, two third grade sen- 
tences, and so on up through the eighth grade and high school, 
ending with two sentences which had proved so difficult that a 
rather small percentage of the first year college class had been 
able to complete them. 

^ This list was presented by the writer at the meeting of Section L of the 
American Association for the Advancement of Science, Dec. 31, 19 14, at Phila- 
delphia. 

' Scale A was reported in Schpol and Society^ April' 10. 19 15, under the title, 
"Some Results of a Graded Series of Completion Tests. 
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2. Scale A, Itself 

On each line of dots, write the word which makes the best meaning 

ONLY ONE WORD ON EACH BLANK 

II 

X. The sky blue. 

y. We arc going school. 

Ill 

X. The kind lady the poor man a dollar. 

y. The plays her dolls all day. 

IV 

X. Time often more valuable money. 

y. Boys and soon become and women. 

V 

X. The poor baby as if it were sick. 

y. The rises the morning and at night. 

VI 

X. It is good to hear ^ voice ^ friend. 

y. She if she will. 

VII 

X. The poor little has nothing to ; he is hungry. 

y. The Doy who hard do well. 

VIII 

X. Men more to do heavy work women. 

y. It is a ~ task to be kind to every beggar for 

money. 

IX 

X. Worry never improved a situation but has made condi- 
tions . 

y, A home is merely a place one live comfortably 

X 

X. It is very to become — acquainted persons who 

timid. 

y. To many things ever finishing any of them a 

habit. 

XI 

X. One's real appears often in his than in his 

speech. 
y. When one feels drowsy and , it happens that he is 

to fix his attention very successfully anything. 

XII 

X. The knowledge of use fire is of 

important things known by but unknown animals. 

y, that arc .. to one by an friend should be pardoned 

readily than injuries done by one is not angry. 

XIII 

X. To friends b always the it takes. 

y. One ought to Kreat care to _ the right of 

, for one who bad habits it to 

get away from them. 



6 Completion'Test LangucLge Scales 

3. Report of Scores Made on Scale A 

During the months of April, May, and June, 191S, over six 
thousand children and young people spent fifteen minutes each 
in an attempt to complete the sentences of Scale A, as shown 
above. In those cases where a third page of sentences was added, 
enough more time was allowed to enable each individual to have 
a reasonable amount of time for each sentence. The majority 
of the classes tested were in the schools of New York and New 
Jersey, although records were obtained from a number of classes 
in Illinois, Indiana, Michigan, Missouri, and Pennsylvania.^ 
The results from these other states indicated that there was no 
great difference in the abilities of children in the same grade in 
different states, so that the measurements here reported may be 
taken as fairly representative of conditions in general. 

The detailed scheme by which each sentence was scored will 
be found in the Appendix, but in order that the reader may under- 
stand what is meant by the score, a word of explanation will be 
given here. Each sentence which the pupil had the opportunity 
to complete was given a score of 2 if perfectly completed, a score 
of I if almost but not quite perfectly completed, and a score of o 
if not attempted at all or if imperfectly done. The child who 
successfully completed two sentences in Scale A would therefore 
receive a score of 4, or 2 points for each sentence. If he had com- 
pleted three sentences perfectly and a fourth very nearly per- 
fectly, his total score would be 7 points. In this way anyone 
who did all the twenty-four sentences of Scale A perfectly in 

^ In these cases it was impossible for the writer himself to eive the tests, 
although there is every reason to believe that the results are fully comparable 
to those given by him personallv. The classes chosen in these states were in 
each case chosen because of the principal's training and understanding of 
scientific testing, and detailed instructions were given each principal in order 
to secure exactly comparable results. All of the papers were scored by the 
same detailed scheme, which was prepared by the writer and will be found in 
the Appendix. All papers were scored either by the writer or by his wife, 
except m the case of some of the papers of the preliminary list on which some 
assistance was nven by one other individual. 

In the New York and New Jersey classes the writer hired substitute teachers 
to assist him in keeping time and collecting papers. He would instruct these 
assistants and train them so that they knew just what to do. He would then 
fo to a class room, explain the test to the children, start them to work, and 
leave one of these assistants to collect the papers while he went to another 
room, where the same procedure was follow^. In this way he was able with 
three assistants to obtain records from a large number of children in a short 
time. In a few instances these trained assistants were allowed to take com- 
plete charge of the administration of the tests after they had become thor- 
oughly familiar with the process. 
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fifteen minutes would receive a total of 48 points, which is the 
maximum possible score in Scale A. 

In addition to the six thousand individuals who tried Language 
Scale A in the form given above, I have gone through the records 
of the five thousand who tried the Graded Series, from which 
Scale A was selected, and have found the total score made by 
each individual in the twenty-four sentences of Scale A. The 
results from these two groups vary little and are combined in 
Table I, which shows the distribution of scores made by the 
pupils of each elementary school grade. Beginning at the lower 
left-hand comer. Table I indicates that a score of o was made by 
255 of the 1318 pupils in the second grade, by 19 of the 1437 pupils 
in the third grade, and by i of the 1463 pupils in the fourth grade. 
Table I not only shows the number of pupils in each grade who 
made each score, but it also shows the median score, or the score 
made by the middle pupil of the grade if all the pupils of the 
grade were arranged in order according to the ability each exhib- 
ited in this test. In addition. Table I gives the range of score 
that would be necessary in each grade to include half of all the 
children in the grade, and the quartile, which is half of the range 
of the middle 50 per cent and will serve as a useful measure of the 
variability. 
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For those interested in the measurement of classes, Table II 
has been prepared, showing the distribution of median class 
scores in the elementary grades. As would be expected, the 
median of the class medians is very nearly equal to the median 
score of all children tested in any given grade. 
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Table III gives facts similar to those of Table I, with regard 
to the higher grades in those school systems where it was possible 
to obtain results from the complete S3^tem including the high 
school. The group headed "College Graduates" was composed 

TABLE m 

DisTBiBunoN OF ScoBBB Made bt Higheb Gradsb in Language Scai«b A 

(Complete System Gboup) 



Score 


Grade 


Grade 


Grade 


Grade 


Grade 


CoOeco 


vni 


IX 


X 


XI 


XII 


QradiMtw 


48 














47 
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5 


46 

46 

44 

43 
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• • 9 % Xaaaa 

• • • m Xaaaa 

O 
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aaaa 9 • • • • 
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• • m » mm m m • • 


aaaa Oaaaa 
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• • • • Oa aaa 
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aaaa XX aaaa 
aaaa X9 aaaa 

a a a a X^ a % m • 
aaaa X^ a a a • 
aaaa X O a • • m 




• • % m \9 • • • • 
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No. tested 


813 


273 


171 


136 


103 


114 






Median Score 


27.861 


80.147 


38.682 


86.727 


37.167 


42.812 


26 Percentile 


24.420 


26.023 


30.100 


32.333 


33al25 


80.376 


76Percentik 


81.707 


34.486 


87.008 


80.077 


40.812 


46.107 


Quartile 


8.688 


4.232 


3.800 


8.372 


3.844 


2.866 
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of graduate students in Educational Administration at Teachers 
College. This last group was used simply as a group superior to 
high school seniors. 

4. Criticism of Scale A 

It will be noticed as one glances up through the grades that 
each successive grade makes a higher score than the grade just 
previous and that the range of the middle 50 per cent likewise 
moves steadily upward. This is, of course, to be expected, al- 
though the relative amounts of progress between grades are 
unusual and need to be examined more carefully. The crude 
score intervals between grade medians are, according to Table I, 
roughly as follows : 

Grades U-in ni-IV IV-V V-VI VX-VH VH-Vni 

Interval 4.4 5.3 4.1 3.5 3.4 2.8 

There is no good reason for thinking that greater progress is 
made between the third and fourth grades than between the 
second and third, and careful examination proves that this 
relatively large advance between the third and fourth grades is 
due to imperfections in Scale A. If it had been possible, in the 
selection of the sentences for Scale A, to select two sentences of 
exactly "median" or 50 per cent difficulty for each grade, and 
then if the pupils tested later had performed exactly as those 
tested previously, there would have been a distinct tendency 
toward the equalization of the score intervals between grades, 
although the intervals would still have decreased in passing to 
higher grades. As it happened, the second grade sentences were 
distinctly too easy (59%, 58%); the third grade sentences 
too hard (46%, 46%) ; and the fourth grade sentences were prac- 
tically 50 per cent sentences (50%, 54%). As a result, the 
third grade did not have as much of a chance to show superiority 
over the second as the fourth had over the third. 

In a later section of this study the relative distances between 
grades are calculated to be about as follows: 

Grades H-IH IH-IV IV-V V-VI VI-VH VH-Vin 

Interyal^ 1.6 1.2 .9 .8 .8 .6 



^The unit upon which these intervals are calculated is the P.E., or the 
median deviation from the median of a grade distribution. This is explained 
in greater detail in the section headed " Normal Surface of Frequency Assumed" 
(p. 30-35), but for the present it may be thought of as a rather accurate unit 
01 measurement which has the same value in alfgrades. 
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Fig. I gives a graphic comparison of the relations of the med- 
ians of the various school grades tested, measured first by the 
crude score on Langus^e Scale A and second by the average of 
three determinations of the P.E. intervals. 

* 4LXA ' ^'^ ' * ^ ' * ' ' « ' ' ** ' ' " ' ' " ' g ' " ' ' ^* ^ " ' " ' ^ ' '=» >♦ 3^ ' ^ ' W ' <i ' W 4» ' V 

I — r—L — ,1 . i ■ T .r i i, i r ii, — ^ — .-^ 

Fig. I. Comparison of the Inter-Grade Intervals Obtained from Crude Score 
in Scale A with Those Obtained Statistically. Each circle above the line 
represents the position of the median of a school grade distribution on the 
scale shown below the line. 

Although the relative positions of the grades are in many 
respects similar in the two projections shown above, the crude 
score on the Langus^e Scale is clearly not sufficiently accurate 
to be used alone. An arrangement of the sentences of Scale A 
on a linear projection similar to the second in Fig. I shows how 
imperfectly Scale A is constructed. 

'"'""N , — ,^ If . ty, ujt f.y far ff t.r . — 

M > tl 2J0 S^jO 4jD i^ Ch0 JJi &|0 9,0 IM ILQ (M 

Fig. 2. Linear Projection of the Difficulty of the Sentences of Language 

Scale A. 

A perfect scale for any function as complex as that tested by 
language completion tests would be very difficult to construct, 
although the scales presented in the next section of this report are 
far superior to Scale A in some particulars. It would be very 
convenient to have a scale in which each step was perfectly 
defined and exactly one unit more difficult than the step preceding 
it, but to secure such a scale would require an enormous amount 
of time and labor, and the advantage gained over a scale which 
approximates those conditions would be slight. A glance at Fig. 2, 
however, shows that there would be great improvement in 
Language Scale A if another step were introduced between sen- 
tences 2 and 1 1 and if some of the sentences between 6 P.E. and 
9 P.E. were omitted. The positions of the various school grade 
medians on the crude score projection in Fig. i indicate the same 
difficulty in Scale A. 
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5. Suggestive Results of Its Use 

In spite of the inequalities that occur in the steps on Language 
Scale A, it has shown some rather interesting possibilities. There 
is a very general conviction among teachers that girls have greater 
ability along language lines than boys. I have gone through my 
records of sixth grade children and tabulated the scores of 1224 
of them according to sex and age.^ The results are shown in 
Table IV. 

On the whole, it appears from Table IV that boys make a 
somewhat lower median score than girls in the same grade, 
although the difference is small and the amount of overlapping 
is enormous. A small sampling from the other elementary 
grades indicated that the same conditions hold true there, so the 
facts shown in Table IV may be taken as fairly typical. It is 
interesting to note that there is a rather distinct tendency for the 
older pupils in the grade to make lower scores than those younger. 
This suggests that teachers are possibly inclined to promote dull 
pupils because of their age and to retard the bright pupils be- 
cause of their youth. However that may be, Table V makes 
it pretty clear that ability counts for a great deal more than 
age in determining promotion. 

In view of all that has been said recently concerning the inabQ- 
ity of teachers to judge the abilities of their pupils and to pro- 
mote them accordingly, the facts shown in Table V are rather 
surprising. To say that a child is twelve years old apparently 
signifies far less concerning his ability to complete sentences 
than to say that he is in the sixth grade. The variability of the 
sixth grade, if the quartile is taken as a measure, is only about 
73 per cent of the variability of the twelve-year-olds. The 
median score of each grade group of twelve-year-old children 
is remarkably near the median score shown in Table I for all 
children in that grade group. There is undoubtedly a very 
close relation between the criteria used by teachers in promoting 
pupils and the abilities required to complete mutilated sentences. 

To measure progress in individual pupils and classes should be 
one of the uses of a good scale. In one school where the writer 
had given the Graded Series in November, 1914, the superin- 



'This tabulation was made before all of the results were available, and 
therefore the total number of sbcth grade children in this tabulation is smaller 
than the total shown in Table I. 
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TABLE IV 
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TABLE V 
DuTBiBiiTtON or 800BB8 Mass by Twilvs-Ymab-Old Chudbkn 
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TABLE VI 

Amountb of Impboyement in Lanquagb Scale A Made in See 

Months' Wobk in School 



Amount of 
Improvement 


Eight-Year-Old 
Boys Girls 


Twelve-Year-Old 
Boys Girls 


18 






17 


1 




16 


2 2 
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No. tested 


44 61 


84 
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Median 
Improvement 


3.5 5.8 


6.1 


6.1 



Table VI indicates that 1 1 boys and 4 girls in the eight-year-old group made exactly the same 
■core in June as in November, while one boy and two girls made one point more in June than 
in November, etc. It is interesting to note that some of the twelve-jrear-old children actually 
made poorer scores in June tlum they had made in November. 



tendent gave Language Scale A in June, 1915. The mid-year 
promotions which intervened had distributed the class groupings 
so that it was impossible to measure the progress of classes. The 
writer, however, searched out the November records of a group 
of eight-year-old children and of a group of twelve- year-old 
children to determine what score each of these children had made 
on the twenty-four sentences of Scale A. This record for each 
individual was then compared with his June record in Scale A, 
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and any change of score was recorded. Table VI shoms the 
changes that were found. The superintendent had emphasiied 
the language work throughout the year on account of the poor 
showing made in November, so that the amount of progress 
shown in Table VI is possibly somewhat larger than would 
ordinarily be found. 

As we have already seen, the steps on Scale A are not equal in 
length. An improvement of ten points score may therefore mean 
something entirely different to two individuals, one of whom 
improves from 5 to 15 and the other from 20 to 30. For this 
reason the facts shown in Table VI are of little value, except as 
an illustration of how improvement may be measured now that 
we have scales on which the consecutive steps are equal. 



Ill 

ADDITIONAL LANGUAGE SCALES 

I. Use of Short Scales 

Although Language Scale A has proved itself a rather useful 
instrument, it has seemed best to arrange a number of shorter 
scales in which the intervals between steps are more nearly 
equal. It often happens that an individual does not feel "at 
his best " on certain days and, whether his level of performance is 
actually lower or not, at such times he feels that it is an injustice 
to him to have his ability judged on the basis of his "off day" 
performance. Measurements of individuals made for the pur- 
pose of obtaining correlations between tests are more useful if 
made at two or more different times with equal tests, for such a 
procedure allows one to make some very desirable corrections for 
the attenuation due to chance inaccuracies in the measures. 
Evidence from two or more measurements of the same indi- 
vidual becomes cumulative and convincing, while a single meas- 
urement may be overlooked as not significant. In fact, the 
amount of difference between the two measurements will often 
be taken as a rough indication of the reliability of the measure- 
ments. For these and other reasons the writer recommends that 
in measuring individuals two short scales be used rather than one 
long scale. 

Although it will always be advisable to use more than one of 
the short scales when an accurate measurement of an individual 
is desired, a class may be measured fairly well by means of a 
single scale. The chance inaccuracies in the measurement of an 
individual, whereby a single measurement gives him credit for 
more or for less ability than he deserves, tend to be balanced by 
inaccuracies in the opposite direction from the measurements of 
other individuals when a group is being measured. Improve- 
ment in a class may be measured by comparing the median score 
made by the class on one scale with the median score made by the 
class at a later date on another scale of the same difficulty, or 
even better by comparing the total distribution on one scale with 

the total distribution on the other equal scale. 
i8 
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a. Scales B and C 

Language Scales B and C are chosen entirely from the care- 
fully evaluated sentences of the Graded Series and the writer feels 
a great deal of confidence in them. Each of these two scales 
consists of ten steps or sentences, each step being about i P.E. 
above the previous step. Scale C, however, is on the whole 
about 4 P.E. more difficult than Scale B. These two scales are 
as follows: 

Wriie only one ward an each blank. 
Time limii, seven minutes. 

Name 



LANGUAGE SCALE B 

I. We like good boys girls. 

6. The is barking at the cat. 

8. The stars and the will shine tonight. 

23. Time often more valuable money. 

23. The poor baby as if it were sick. 

31. She if she will. 

35. Brothers and sisters always to help other 

and should quarrel. 

38. weather usually a good effect one's spirits. 

48. It is very annoying to ^ tooth-ache, often 

comes at the most time imaginable. 

54. To friends is always the it takes. 



Write only one word on each Hank. 
Time limtt, seven minutes. 

Name ... 

LANGUAGE SCALE C 

2. The sky blue. 

5. Men older than boys. 

12. Good boys kind their sisters. 

19. The giri fell and her head. 

24. The rises the morning and at night. 

30. The boy who hard do well. 

37. Men more to do heavy work women. 

44. The sun b so that one can not 

directly causing great discomfort to the eyes. 

53. The knowledge of use fire is of 

important things known by but unknown ... ^_ animals. 

56. One ought to great care to the right of 

, for one who bad habits it to 

get away from them. 



do 
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The exact difficulty of each sentence in Scales B and C, with 
the intervals between consecutive steps, is shown in Table VII. 

TABLE VII 
Steps and Intbbvals Between Steps on Scales B and C. 1»P.E. 



Language Scale B 


Language Scale C 


Sent. No. 


Value 


Interval 


Sent. No. 


Value 


Interval 


1 
6 
8 
22 
23 
31 
35 
38 
48 
54 


.96 
1.98 
2.94 
4.26 
5.40 
6.50 
7.42 
8.42 
9.50 
10.76 


1.02 
.96 
1.32 
1.14 
1.10 
.92 
1.00 
1.08 
1.26 

• 


2 
5 
12 
19 
24 
30 
37 
44 
53 
56 


1.38 
2.52 
3.58 
4.47 
5.69 
6.95 
7.85 
8.95 
10.05 
11.17 


1.14 
1.06 

.89 
1.22 
1.26 

.90 
1.10 
1.10 
1.12 



The same facts are shown graphically in Fig. 3. 
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Fig. 3. Linear Projection of Language Scales B and C. 
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Exactly seven minutes of actual work should be allowed any 
individual on either of these two scales. In testing school chil- 
dren» the procedure outlined below should be carefully followed 
in order that all measurements may be exactly comparable. 

3. Directions for Administering Tests 

If the class to be tested is a fourth grade class or higher, oral 
explanations will be sufficient. Below the fourth grade it will 
be necessary to distribute to each pupil the following practice 
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list, before allowing any pupil to see the scale with which he is 
to be measured. 

PraOke Sheet 

Two and two are . 

A boy b little, but a man is 

Girls and boys can run play- 

The boy has book. 

After passing one of these practice sheets to each child, make 
the following general explanations: 

I want to see if you can read what is printed on the little sheet of paper, and 
whether you can guess what words have been left out. Each little dotted 
line shows where a word was left out. If you can guess what word ought to 
be there, write it on the dotted line. Write just one word on each blank. 
Make each line say something. 

After making the above explanation, the teacher and the 
examiner should give assistance to any child who does not 
understand, seeing that each child learns what is expected. 

After the examiner is confident that each child has the correct 
idea of how to proceed, a copy of the scale to be used should 
be held up in full view of the entire class and the statement made 
that "This page is very much like the little sheet on which you 
have just been working, except that the last sentences on this 
sheet are very much harder. " From this point the procedure 
is practically the same as that for the higher grades. 

In the fourth grade or above, or after the preliminary practice 
just described has been completed in a lower grade, the following 
oral explanation of the scale to be used should be made before 
distributing any papers : 

This sheet contains some incomplete sentences, which form a scale. This 
scale is to measure how carefully and rapidly you can think, and especially 
how good you are in your language work. 

You are to write one word on each blank, in each case selecting the word 
which makes the most sensible statement. 

You may have just seven minutes in which to sign your name at the top 
of the page and write the words that are missing. The papers will be passed 
to you with the face downward. Do not turn them over until we are all ready. 
After the signal is given to start, remember that you are to write just one 
word on each blank and that your score depends on the number of perfect 
sentences you have at the end of seven minutes. 

If there are no questions, the papers may then be distributed, 
taking care that no child looks at the printed side until there 
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is a paper upon the desk of each child and the following additional 

instructions have been given: 

After you have been working seven minutes, I shall say, "The time is up. 
All stop writing!" You will all please stop at once and lay aside your pens 
(or pencils). Now if you are all ready, you may turn your papers, sign your 
names and fill the blanks. 

Take note of the exact time at which the signal to start was 
given, allow exactly seven minutes, and give the command to 
stop writing. Collect all papers at once. It is very important 
that exactly seven minutes be allowed. A stop watch is the 
most satisfactory means of keeping the time on a test of this sort. 

Grade each paper according to the scheme shown in the Appen- 
dix of this monograph, and make a record of the total number 
of points made by each child, in order that the amount of prog- 
ress made by each pupil may be readily determined when the 
scale is used the second time. (It would be advisable not to 
use the same scale again until a year or more has passed. Use 
a different scale of the same difficulty.) 

To calculate the median score of a class follow the directions 
given in Section 3 of the Appendix. 

4. Scales D and E 

Language Scales D and £ are practically of the same difficulty 
as Scales B and C. Scales D and E, however, each contain four 
sentences which were not a part of the Graded Series,* and al- 
though these two scales will be found very satisfactory, it is 
entirely possible that the difficulty of any one of the eight 
sentences referred to may differ as much as .3 or .4 P.E. from the 
value I have assigned to it. As a matter of fact, the course of 
this investigation has shown that the difficulty of a test sentence 
is influenced rather markedly by the number and character of 
the sentences near it. This does not, however, invalidate the 
scale ; it merely indicates that the final value of each step on a 
scale of this kind cannot be determined accurately until thou- 
sands of children of all grades have attempted the scale in its 
final form. Indeed, it is questionable whether the utilities 
added by knowing so accurately the final value of each step would 

> All sentences numbered from i to 56 were in the Graded Series and, as will 
be found from reading Chapter IV of this monograph, the difficulty of each of 
them has been very well defined. The difficulty of all sentences numbered 
above 56 has been estimated as carefully as possible. 
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be of sufficient practical importance to pay one for the labor of 
making the determination. 
Language Scales D and £ are as follows : 

WrUe only one word on each blank. 
Time Umit, seven minutes. 

Name 

LANGUAGE SCALE D 

4. We are going school. 

76. I to school each day. 

II. The plays her dolls all day. 

21. The rude child does not many friends. 

63. Hard makes tired. 

27. It is good to hear voice ~ friend. 

71. The happiest and contented man is the one lives a 

busy and useful ^.....^ . 

43. The best advice usually obtained one's 

parents. 

51. «-^... things are ^ satisfying to an ordinary than 

congenial friends. 

84. a rule one association friends. 



WrOe only one word on each blank. 
Time Umtt, seven minutes. 

Name 



LANGUAGE SCALE E 

73. I see you. Can you see ? 

75. Ice is cold, but fire is . 

7. The kind lady the poor man a dollar. 

18. The best to sleep is at night. 

58. Children should many lessons from parents. 

25. The child the river was drowned. 

34. It is a task to be kind to every beggar for 

money. 

36. Worry never improved a situation but has made 

conditions . 

52. When one feels drowsy and , it happens that he is 

to fix his attention very successfully anything. 

83. In order clearly at it is to .~ 

artificial 

The difficulty of each sentence in Scales D and E is shown 
in Table VIII. 
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TABLE VIII 
Steps and Intbbvaub between Steps on Scales D and E. 1«P.E. 



Tianguage Scale D 


Language Scale E 


Sent. No. 


Value 


Interval 


Sent. No. 


Value 


Interval 


4 


1.00 


.97 


73 


1.18 


.45 


76 


1.97 


1.34 


75 


1.63 


1.71 


11 


3.31 


1.09 


7 


3.34 


1.08 


21 


4.40 


1.14 


18 


4.42 


1.13 


63 


5.54 


1.13 


58 


5.55 


.77 


27 


6.67 


.^7 


25 


6.32 


.99 


71 


7.64 


1.22 


34 


7.31 


1.01 


42 


8.86 


.92 


36 


8.32 


.97 


51 


9.78 


1.07 


52 


9.29 


1.26 


84 


10.85 




83 


10.55 





Fig. 4 represents the same facts in a graphic way. 



Scale D 



r 



I 



5 



■ 



■T" 

4 



II 



n 

O 









10 



ST- 



I 



8 



t 



Scole E. 73 75 

G Q 



11 



h 



o 



90 

G 







i* 



14 



£ 






II 



i e 

Fig. 4. 



3456789 10 

Linear Projection of Language Scales D and £. 



It will be observed that Scale E is somewhat more irregular 
and has a slightly shorter range than Scale D. The lower end 
of Scale E is a bit more difficult than the lower end of Scale D, 
while Scale D is the more difficult in the upper ranges. In spite 
of these differences, these two scales may ordinarily be used as 
though they were equal to each other and to Scales B and C. 

The instructions given above for the administration of Scales 
B and C apply equally well to these two scales. 



Additumal Language Scales 05 

5. Scales J and K 

Scales J and K are intended to measure the abilities of young 
people and adults rather than of children. The time to be al- 
lowed is exactly five minutes for each of the scales, although 
the general procedure described above for Scales B and C should 
be followed in their administration. The intervals between 
steps in these two scales are intentionally made long, the upper 
steps are very high, and there are no sentences easier than 4. P.E, 
Care should be taken not to confuse Scales J and K with any 
other scales, for each of these two is equal to the other only. 

Language Scales J and K are as follows: 

Write ofdy one word on each blank. 
Tune UmU, fixe minutes. 

Name 



LANGUAGE SCALE J 

39. Boys and soon become and women. 

61. The are often more contented the rich. 

64. The rose is a favorite because of fragrance and 

41. It is very to become acquainted persons 

who timid. 

93. Extremely old .^ sometimes almost as care as 

87. One's in life upon so factors it is 

not to state any single for failure. 

89. The future of the stars and the facts of history are 

now once for all, I like them not. 



Write only one word on each blank. 
Time limit, five minutes. 

Name ... 



LANGUAGE SCALE K 

16. The boy will his hand if plays with fire. 

57. Hot weather comes in the and weather the 

winter. 

28. The poor little has nothing to ; he is hungry. 

33. Very few people how to spend time and to the best 

advantage. 

83. One not, as a , attention uninter- 
esting things. 

90. To eat one is is a pleasure. 

86. they us not, nature's are —......-.«. 

and unchangeable. 
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Table IX shows the values that were obtained for each sen- 
tence in Scales J and K. 

TABLE IX 
Stbps and Intbbvals between Steps on Scales J and K. 1>-P.E. 



Language Scale J 


Language Scale K 


Sent. No. 


Value 


Interval 


Sent. No. 


Value 


Interval 


29 


4.12 


1.73 


16 


4.15 


1.83 


61 


6.85 


1.17 


57 


5.98 


1.06 


64 


7.02 


1.35 


28 


7.04 


1.34 


41 


8.37 


1.16 


33 


8.38 


1.18 


93 


9.53 


1.22 


82 


9.56 


1.23 


87 


10.75 


1.56 


90 


10.79 


1.86 


89 


12.31 




86 


12.65 





Fig. 5 is a linear projection showing the positions of each 
sentence of Scales J and K on the P.E. scale. 
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Fig. 5. Linear Projection of Language Scales J and K. 
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The value obtained for each sentence in Scale K is remarkably 
near the value obtained for the corresponding sentence in Scale 
J. The possibility that some of these values may shift when 
tried out on thousands of individuals is, however, even greater 
than in the case of Scales D and E. The values given in Table 
IX are nevertheless the most accurate obtainable at present 
and may be used with confidence until more exact values have 
been established. Scales J and K are unquestionably the most 
equally matched pair of completion tests for measuring young 
people and adults that have yet been obtained in the English 
language. 
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6. Scales L and M 

For the measurement of smaller differences in the abilities 
of secondary school pupils, I have arranged Scales L and M, 
which begin at about 7 P.E. and progress by relatively small 
steps to over 11 P.E. These are also five-minute tests. It is 
believed that they will be found very valuable to secondary 
school teachers and others interested in the abilities of young 
people. 

The sentences composing Language Scales L and M are given 
below. 

Write only one word on each Uanh, 
Time Umit, five minutes. 

Name ^ — .^. ^...^.^ 



LANGUAGE SCALE L 

60. Children are rude not easily win friends. 

66. Plenty . exercise and air healthy . ■ 

and girls. 

70. In to maintain health, one should have nourishing 



65 happiness can not be with money. 

32. One's do always express his thoughts. 

92. To to wait, after having to go , very 

annoying. 

78. It is sometimes to between two of action. 

97. One can do his at one while of 

another. 

Write only one word on each blank. 
Time Umit, five minutes. 

viame ..„. .m 



LANGUAGE SCALE M 

67. One can not foretell will happen in the . 

59. The dog a useful because his intdligence 

and faithfulness. 

95. Many people their health because do not the 

of hygiene. 

79. Nothing can one's happiness ^ effectively than a guilty 



45. To many things ever finishing any of them a 

habit. 

91. The seems and dreary a discouraged . 

55. that are to one by an ^ friend should be par- 
doned readily than injuries done by one b not 

angry. 

88. It is that a full-grown man should a ghost he 
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Table X shows the values which have been obtained for each 
sentence in Scales L and M. 



TABLE X 

StBPS and iNTEBVAIiB BBTWBBN StEPS ON 



SCAI«BB L AND M. 1«P.E. 



Language Scale L 


Language Scale M 


Sent. No. 


Value 


Interval 


Sent. No. 


Value 


Interval 


60 


6.83 


.67 


67 


6.03 


.53 


66 


7.40 


.61 


50 


7.46 


.48 


70 


7.01 


.47 


05 


7.04 


.54 


65 


8.38 


.53 


70 


8.48 


.^ 


32 


8.01 


.80 


45 


0.04 


.84 


02 


0.71 


.43 


01 


0.88 


.31 


78 


10.14 


.07 


55 


10.10 


.05 


07 


11.11 




88 


11.14 





Fig. 6 shows the positions of all sentences in Scales L and M« 
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Fig. 6. Linear Projection of Language Scales L and M. 



Notb: The scales described in this chapter, together with the Practice Sheet 
shown on page 2i, may be purchased in any quantity from the Teachers Col- 
lege Bureau of Publications. 
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IV 

CALCULATION OF THE DIFFICULTY OF TEST 

SENTENCES 

I. Variability of a Grade as the Unit 

The comparison of adjectives is a device used by all people 
to denote different amounts of qualities. When one makes the 
judgment that John is "brighter" than Joe, he has made a rough 
measurement of the amount of the quality termed ''brightness" 
possessed by these two boys. If everyone knew John and Joe 
and their relative brightness, and if these two boys maintained 
exactly the same degrees of that quality from the present time 
forward, John and Joe might serve as a rough scale for brightness. 
It would then be possible to say that James has '* the brightness 
of John " with some assurance of being understood. The diffi- 
culty with such an arrangement is that John and Joe both change 
in brightness and at different rates. It is also impossible for 
everyone to know these two boys, and therefore they cannot 
be of very wide service as a brightness scale. Any scale that is 
to be of much service must be built of units the amounts of which 
remain constant and in such form that they can be readily 
examined by anyone interested or verified by any competent 
person. 

It would be possible to build up a completion-test scale by 
merely selecting a series of sentences which the majority of a 
group of people agreed upon as arranged in the order of their diffi- 
culty. Or, one might select as a scale a series of sentences which 
had been tried upon a group of children and found to be so ar- 
ranged in the order of their difficulty that each consecutive sen- 
tence was correctly completed by just lo per cent of the group less 
than had completed the previous sentence. Such scales would no 
doubt be much more useful than an entirely ungraded series 
of sentences. Unless the above scales were based upon a firmer 
foundation than I have indicated, however, it would perhaps 
be found that a second group of judges would disagree with the 
first group in regard to a few of the sentences, and that a second 
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group of children would show percentages entirely different 
from the first, possibly to the extent of showing no more than 20 
per cent difficulty between the hardest and the easiest sentences 
in the series, which with the previous group had a range of 100 
per cent. There is need for some less changeable unit than uncer- 
tain majorities or percentages of variable groups. 

One of the most constant things about a variable fact is the 
amount of its variability. One's accuracy as a judge of any 
quality remains fairly constant, and the accuracy of one group 
of judges very nearly equals the accuracy of any other similarly 
chosen group. 

The variation in the abilities of the children in one group is 
about equal to the variation in the abilities in any other group 
of children chosen in the same way. Teachers select their 
brightest pupils for promotion and refuse to promote the dullards. 
Now the abilities of teachers to make this selection is about the 
same in one school system as it is in another, and about the same 
in eighth grade teachers as it is in second grade teachers. As a 
result, one school grade may differ quite markedly from another 
in ability and yet the amount of variability in one will be very 
nearly equal to the amount of variability in the other. If one 
desires to make a scale for use in all grades, then, it would seem 
desirable to use some measure of the variability of a grade as 
the unit, since this is at once common to all grades and only 
slightly variable in itself. 

2. Normal Surface of Frequency Assumed 

Before choosing any particular measure of the variability of 
a grade to be used as a unit of measurement, it will be valuable 
to discover how the "completion-test ability" is distributed in 
each grade. If this ability is distributed in the same way as 
the abilities by which teachers judge to what grade a child belongs, 
we should expect to find most of the children in any given grade 
clustered about the average or median for that grade. We 
should not expect to find that teachers always make perfect 
judgments as to promotions, but we should expect to see fewer 
large errors than small ones. In short, we should expect to find 
the abilities of the children in any given grade distributed sym- 
metrically on each side of the average, as shown in Fig. 7. 
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Fig. 7. Symmetrical Form of Distribution of Abilities to be Expected 

of Children in Any Given Grade. 

The height of the curve above the base-line indicates the number of 
individuals in the class having the ability shown on the base-line scale. 
Each individual is represented by an equal amount of the total area 
inclosed by the curve and the base-line. 

Assuming that Language Scale A is a reasonably valid meas- 
uring instrument for the completion-test ability, Figs. 8 to 14 
show how this ability was distributed in the 1400 children of 
each elementary grade tested by the writer.* Except in the 
second and third grades,' the curves are remarkably sjonmetrical 
and regular, conforming on the whole to the general character- 
istics of the normal surface of distribution shown in Fig. 7.' All 
the evidence at hand leads us to believe that the distribution 
of the abilities measured by the completion test conforms to 
this shape in each grade, and it will therefore be assumed through- 
out the remainder of this study. 

Assuming the normal surface of frequency, then, the Median 
Deviation or P.E. from the median will be the most convenient 
measure of the variability to use as a unit. Of course one might 
use the distance between the best and the poorest individuals 
in the class as a measure of the variability, but this would give 
such a large unit that the scale would be practically useless as 
a measure of small differences. Another reason for not using 
the extreme range of the distribution as a measure is the fact 
that the few very poor individuals and the few very good indi- 
viduals in each grade would have more influence over the size 
of the unit than all the hundreds of average children in the grade. 

^ The data upon which Figs. 8 to 14 are based are shown in Table I. 

' The excessive height of the columns for scores of o, 2, 4, 6 and 8 in the 
second and third grade figures is due to the peculiarities of the method of 
scoring, in that 2 points score were given for each perfect sentence and i point 
for each partially perfect sentence. The children in these lower grades as a 
rule either get the sentence perfect or not at all. 

'This fact in itself is not conclusive proof that completion-test ability is 
distributed according to the normal surface of distribution. Better proof 
is found in the fact that if this assumption is made the results that follow are 
in such close accord with known facts. 
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Median Score 

— Each area of Ihis sjze /^presents 

the score of one pupil on Scoffi A 



Fic. 8. Distribution of ScoreB Made by Second Gmde Pupila on Sole A. 




Fig. 9. Dutribution of Scores Made by Third Grade Pupils on Scale A. 




Fig. 10. Distribution of Scores Made by Fourth Grade Pupils on Scale A 
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Fio. 14. Diatribution of Score* Made by E«hth Grade Pupib on Scale A. 
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The median deviation is the median amount of deviation^ 
whether the deviations are above the median of the distribution 
or below. If all the children in the grade were arranged in order 
according to their distance from the median along the base-line 
scale, we might begin at the median and count out just one half 
of the children. The distance along the base-line covered in 
counting out half of the children would be the median deviation. 




Fig. 15. Lower Half of a Normal Surface of Frequency. 

Fig. 15 shows the lower half of a normal surface of frequency, 
with a line drawn perpendicular to the base in such a way as to 
cut off just one half of the area below the median. Half of the 
deviations represented by the total area shown are greater than 
line BD and half of them are less than line BD. BD is therefore 
the median deviation from the median, or the P.E., as it will 
be called for convenience in this study. 

Since the normal surface of distribution is perfectly sjmmiet- 
rical, the area ABC shown in Fig. 15 represents just one half 
or 50 per cent of all the individuals represented by the total 
surface. Since area DBCE is just one half of area ABC it must 
contain one fourth or 25 per cent of the total number of indi- 
viduals. If one draws a line perpendicular to the base at a 
point I P.E. below the median of a normal surface of distribution, 
he will always divide the lower half of the distribution into two 
equal parts, each of which contains 25 per cent of the total dis- 
tribution. Drawing a line i P.E. above the median would like- 
wise divide the upper half of the distribution into two equal 
parts, each containing 25 per cent of the total area. 

The characteristics of a normal surface of distribution have been 
very carefully worked out. We know that the middle 50 per cent 
of any such surface is contained within the limits — i P.E. and 
-fi P.E. We know that if we start from the median of the dis- 
tribution and go I P.E. in either direction, a perpendicular line 
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Fig. 1 6. Nomial Surface of Frequency, with P.E. Distances from Median. 

to the base at that point would so divide the distribution that 
35 per cent of all frequencies would lie between that line and the 
median; if we pass on to a point 2 P.E. from the median, 41.13 
per cent of the cases would lie between the perpendicular and the 
median; at 3 P.E. from the median, 47.85 per cent of all cases 
are between the perpendicular and the median; and at 4 P.E. 
from the median, 49.65 per cent of the surface lies between the 
perpendicular and the median. Theoretically, the curve and 
the base-line do not meet but continue to approach each other as 
the distance from the median becomes greater. For practical 
purposes, however, we may consider that they meet at about 
4.6 P.E. from the^ median, for a perpendicular drawn here cuts 
off only 0.1 per cent of all the surface. 

3. Scaling the Sentences of Scale A for Each Grade 

Having adopted the P.E. of a grade as the unit of measure- 
ment, and having assumed that the normal surface of frequency 
represents the distribution of completion-test ability in any 
given grade, we may now attempt to arrange our sentences upon 
a P.E. scale for each grade. 

Table XI gives the total number of points score made in each 
elementary grade upon each sentence of Language Scale A, and 
the score that would have been made on any given sentence if 
every child in a grade had succeeded in completing it perfectly. 

Table XI indicates that Sentence No. 2, "The sky 

blue," was given 1798 points out of a possible 2636 in the second 
grade, 2597 out of a possible 2874 points in the third grade, etc. 
Turned into per cents, sentence No. 2 made 68.21 per cent of 
the total score possible for it in the second grade, 90.36 per cent 
in the third grade, etc. Since the number of children tested was 
different in each grade, it will be necessary thus to reduce all 
scores to percentages in order that the surfaces of distribution 
may all be of the same area. The scores shown in Table XI are 
given in percentages by Table XII. 
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TABLE XI 

Score Made bt Each Elementart Grade on Each Sentence of 

Language Scale A 



Sentence 
No. 


Grade 
II 


Grade 
III 


Grade 
IV 


Grade 
V 


Grade 
VI 


Grade 
VII 


Grade 
VIII 


Graded Scale A 
Series 

2 2x 

4 2y 

7 3x 

11 3y 

22 4x 

29 4y 

23 5x 

24 5y 

27 6x 
31 6y 

28 7x 

30 7y 
37 8x 
34 8y 
36 9x 
43 9y 
41 lOx 
45 lOy 
49 llx 

52 lly 

53 12x 

55 12y 

54 13x 

56 13y 


1798 

1834 

575 

568 

♦131 

192 

♦85 

♦97 

♦49 

♦30 

♦29 

♦12 

♦3 

♦6 


2597 

2660 

1594 

1612 

714 

961 

689 

554 

487 

384 

258 

235 

61 

135 

6 

2 

3 

3 


2760 

2813 

2247 

2274 

1655 

1787 

1313 

1078 

967 

999 

663 

676 

347 

431 

51 

35 

94 

24 

3 

8 

1 

2 

3 


2884 

2957 

2668 

2704 

2381 

2470 

1881 

1775 

1329 

1317 

1090 

1105 

652 

753 

170 

168 

293 

93 

33 

18 

12 

11 

5 

3 


2752 

2865 

2750 

2747 

2568 

2650 

2150 

2131 

1542 

1721 

1477 

1455 

1027 

1181 

439 

455 

550 

241 

111 

71 

36 

25 

17 

11 


2825 

2885 

2854 

2806 

2797 

2766 

2405 

2408 

1833 

1950 

1790 

1775 

1464 

1525 

916 

917 

925 

432 

379 

290 

120 

108 

45 

35 


2766 

2818 

2801 

2791 

2781 

2790 

2528 

2565 

1943 

2050 

1925 

1987 

1573 

1771 

1244 

1272 

1280 

749 

695 

580 

302 

242 

141 

103 


No. tested 


1318 


1437 


1463 


1507 


1454 


1456 


1427 








♦1029 














Perfect Score 


2636 


2874 


2926 


3014 


2908 


2912 


2854 








♦2058 















A sentence like No. 36, which no one of the 131 8 children in 
the second grade was able to complete, is very evidently too 
difficult for second grade pupils. Just how much too difficult it 
is we do not know, but if we assume the normal surface of fre- 
quency we know that it is more than 4.6 P.E. above their median, 
for if it were nearer to the second grade median than that dis- 
tance, it would probably have received a score in this grade. As it 
is, the entire surface of the second grade distribution lies below 
sentence No. 36. A sentence receiving a score of 25 per cent in the 
second grade would be just 25 per cent or i P.E. too difficult for 
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TABLE Xn 

Pbb Cent that Score Made bt Each Elementabt Grade ib of Perfect 
Score for Each Sentence of Language Scale A 



Sentence 
No. 



Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


II 


III 


IV 


V 


VI 


VII 



Grade 
VIII 



2 


2x 


4 


2y 


7 


3x 


11 


3y 


22 


4x 


29 


4y 


23 


5x 


24 


6y 


27 


6x 


31 


6y 


28 


7x 


30 


7y 


37 


8x 


34 


8y 


36 


9x 


43 


9y 


41 


lOx 


45 


lOy 


49 


llx 


52 


lly 


53 


12x 


55 


12y 


54 


13x 


56 


13y 



68.21 

69.57 

21.82 

21.55 

6.37 

7.29 

4.13 

4.72 

2.39 

1.46 

1.41 

.59 

.15 

.29 






90.36 

92.55 

55.46 

56.09 

24.85 

33.44 

23.98 

19.28 

16.95 

13.36 

8.98 

8.18 

2.12 

4.70 

.21 

.07 

.11 

.11 



94.32 

96.14 

76.79 

77.72 

56.63 

61.07 

44.87 

36.85 

33.05 

34.15 

22.66 

23.11 

11.86 

14.73 

1.75 

1.20 

3.21 

.86 

.11 

.27 

.03 

.07 

.11 



95.68 

98.19 

88.52 

89.71 

78.99 

81.95 

62.41 

58.89 

44.09 

43.70 

36.17 

36.67 

21.63 

24.98 

5.64 

5.58 

9.72 

3.09 

1.10 

.60 

.40 

.37 

.17 

.14 



94.64 

98.52 

94.57 

94.46 

88.33 

91.13 

73.93 

73.28 

53.03 

59.18 

50.79 

50.03 

35.32 

40.61 

15.10 

15.65 

18.91 

8.29 

3.82 

2.44 

1.24 

.86 

.58 

.38 



97.01 

99.07 

98.01 

96.36 

96.05 

94.99 

82.59 

82.69 

62.95 

66.96 

61.47 

60.95 

50.27 

52.37 

31.46 

31.49 

31.76 

14.84 

13.02 

9.96 

4.12 

3.71 

1.55 

1.21 



96.92 
98.74 
98.14 
97.79 
97.44 
97.76 
88.58 
89.88 
68.08 
71.83 
67.45 
69.62 
55.12 
62.05 
43.59 
44.57 
44.86 
26.24 
24.35 
20.32 
10.58 
8.48 
4.94 
3.61 



the median second grade pupiL Sentence No. 2, which received 
a score of 68.21 per cent in the second grade, is just 18.21 per 
cent too easy (68.21 —50.00 = 18.21) for the median child in this 
grade. Reference to Table XIII,^ which gives the P.E. values 
of each tenth of a per cent from 0.0 to 49.9 above or below 50 
per cent, indicates that 18.21 per cent difference is equal to .702 
P.E. We may therefore locate sentence No. 2 with reference 
to the second grade median as at —.702. Sentence No. 4, 
having a 69.57 per cent score, is just 19.57 P^^ cent too easy 
(69.57 — 50.00 = 19.57) ior the median second grade child, and ref- 
erence to Table XIII locates the sentence at a distance of .759 P. E. 
from the median. Since it is too easy for the median child, the 
sentence will be below the second grade median, or exactly — .759. 

^ Table XIII is taken directly from B. R. Buckinghain's Spelling Abilitv 
(Table XL VI I). It. is a modification of the table given in E. L. Thomdikes 
Mental and Social Measurements (page 200). 
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TABLE XIII 

P.E. Values Corresponding to Given Per Cents of the Normal Surface 
OF Frequency, Per Cents Being Taken From the Median 



% 


.0 


.1 


.2 


.3 


.4 


.6 


.6 


.7 


.8 


.9 





.000 


.004 


.007 


.011 


.016 


.019 


.022 


.026 


.030 


.033 


1 


.037 


.041 


.044 


.048 


.052 


.056 


.069 


.063 


.067 


.071 


2 


.074 


.078 


.082 


.086 


.089 


.093 


.097 


.100 


.104 


.108 


3 


.112 


.116 


.119 


.123 


.127 


.130 


.134 


.138 


.141 


.146 


4 


.149 


.163 


.166 


.160 


.164 


.168 


.172 


.175 


.179 


.183 


6 


.187 


.190 


.194 


.198 


.201 


.206 


.209 


.213 


.216 


.220 


6 


.224 


.228 


.231 


.236 


.239 


.243 


.246 


.250 


.264 


.268 


7 


.261 


.266 


.269 


.273 


.277 


.280 


.284 


.288 


.292 


.296 


8 


.299 


.303 


.307 


.311 


.316 


.318 


.322 


.326 


.330 


.334 





.337 


.341 


.346 


.349 


.363 


.357 


.360 


.364 


.368 


.372 


10 


.376 


.380 


.383 


.387 


.391 


.395 


.999 


.403 


.407 


.410 


11 


.414 


.418 


.422 


.426 


.430 


.434 


.437 


.441 


.445 


.449 


12 


.453 


.467 


.461 


.464 


.468 


.472 


.476 


.480 


.484 


.480 


13 


.492 


.496 


.600 


.604 


.508 


.512 


.516 


.619 


.623 


.627 


14 


.631 


.636 


.639 


.643 


.647 


.651 


.555 


.559 


.663 


.667 


16 


.671 


.676 


.679 


.683 


.688 


.692 


.596 


.600 


.603 


.608 


16 


.612 


.616 


.620 


.624 


.628 


.632 


.636 


.640 


.644 


.648 


17 


.662 


.666 


.660 


.666 


.669 


.673 


.677 


.681 


.686 


.689 


18 


.693 


.698 


.702 


.706 


.710 


.714 


.719 


.723 


.727 


.731 


10 


.736 


.740 


.744 


.748 


.752 


.756 


.761 


.765 


.769 


.773 


20 


.778 


.782 


.786 


.790 


.796 


.799 


.803 


.807 


.812 


.816 


21 


.820 


.826 


.829 


.834 


.838 


.842 


.847 


.851 


.866 


.860 


22 


.864 


.869 


.873 


.878 


.882 


.886 


.891 


.896 


.900 


.904 


23 


.909 


.913 


.918 


.922 


.927 


.931 


.936 


.940 


.946 


.949 


21 


.964 


.968 


.963 


.968 


.972 


.977 


.982 


.986 


.991 


.996 


26 


1.000 


1.006 


1.009 


1.014 


1.019 


1.024 


1.028 


1.033 


1.038 


1.042 


26 


1.047 


1.062 


1.067 


1.062 


1.067 


1.071 


1.076 


1.081 


1.086 


1.091 


27 


1 096 


1.101 


1.106 


1.110 


1.115 


1.120 


1.126 


1.130 


1.135 


1.140 


28 


1.146 


1.160 


1.166 


1.100 


1.165 


1.170 


1.176 


1.181 


1.186 


1.191 


29 


1.196 


1.201 


1.206 


1.211 


1.217 


1.222 


1.227 


1.232 


1.238 


1.243 


30 


1.248 


1.263 


1.269 


1.264 


1.269 


1.275 


1.279 


1.286 


1.291 


1.296 


31 


1.302 


1.307 


1.313 


1.318 


1.324 


1.329 


1.336 


1.340 


1.346 


1.361 


32 


1.367 


1.363 


1.368 


1.374 


1.380 


1.386 


1.391 


1.397 


1.403 


1.409 


33 


1.416 


1.421 


1.427 


1.432 


1.438 


1.444 


1.450 


1.466 


1.462 


1.469 


34 


1.476 


1.481 


1.487 


1.493 


1.499 


1.606 


1.612 


1.518 


1.524 


1.631 


36 


1.637 


1.643 


1.649 


1.666 


1.563 


1.569 


1.676 


1.682 


1.689 


1.696 


36 


1.002 


1.609 


1.616 


1.622 


1.629 


1.636 


1.643 


1.649 


1.656 


1.663 


37 


1.670 


1.677 


1.686 


1.692 


1.699 


1.706 


1.713 


1.720 


1.728 


1.736 


38 


1.742 


1.749 


1.767 


1.766 


1.772 


1.780 


1.788 


1.795 


1.803 


1.811 


30 


1.819 


1.827 


1.836 


1.843 


1.861 


1.869 


1.867 


1.875 


1.884 


1.892 


40 


1.900 


1.909 


1.918 


1.926 


1.935 


1.944 


1.963 


1.962 


1.971 


1.979 


41 


1.988 


1.997 


2.007 


2.016 


2.026 


2.036 


2.044 


2.064 


2.064 


2.074 


42 


2.083 


2.093 


2.103 


2.114 


2.124 


2.134 


2.146 


2.166 


2.166 


2.177 


43 


2.188 


2.199 


2.211 


2.222 


2.234 


2.245 


2.257 


2.269 


2.281 


2.293 


44 


2.306 


2.318 


2.331 


2.344 


2.357 


2.370 


2.384 


2.397 


2.411 


2.426 


46 


2.439 


2.463 


2.468 


2.483 


2.498 


2.514 


2.630 


2.546 


2.662 


2.679 


46 


2.697 


2.614 


2.631 


2.648 


2.667 


2.686 


2.706 


2.726 


2.746 


2.767 


47 


2.789 


2.811 


2.834 


2.867 


2.881 


2.905 


2.932 


2.968 


2.986 


3.016 


48 


3.044 


3.077 


3.111 


3.146 


3.182 


3.219 


3.268 


3.300 


3.346 


3.396 


49 


3.460 


3.606 


3.671 


3.643 


3.726 


3.820 


3.938 


4.083 


4.276 


4.600 


% 


.0 


.1 


.2 


.3 


.4 


.6 


.6 


.7 


.8 


.9 
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Table XIV shows the differences between 50 per cent (or the 
grade median) and the percentages given in Table XII. Table 
XV shows the P.E. equivalents of these differences shown in 
Table XIV, or the location of each sentence of Scale A with 
reference to the median of each elementary grade. 

TABLE XIV 

DiFFBBBNCB BETWEEN FiFTT PeR CeNT AND PeR CeNT OF PERFECT SCORB 

Made Bt Each Elementary Grade for Each Sentence of Lan- 
guage Scale A 



Sentence 

No. 



Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


II 


III 


IV 


V 


VI 


VII 



Grade 

vni 



2 
4 
7 
11 
22 
29 
23 
24 
27 
31 
28 
30 
37 
34 
36 
43 
41 
45 
49 
52 
53 
55 
54 
56 



2x 

3x 

3y 

4x 

5x 
6x 

«y 

7x 

7y 

8x 

8y 

9x 

9y 

lOx 

lOy 

llx 

iiy 

12x 
12y 
13x 
13y 



18.21 
19.57 
-28.18 
28.45 
43.63 
42.71 
•45.87 
45.28 
47.61 
48.54 
48.59 
49.41 
49.85 
49.71 



40.36 

42.55 

5.46 

6.09 

25.15 

•16.56 

26.02 

30.72 

33.05 

36.64 

41.02 

41.82 

.47.88 

45.30 

49.79 

49.93 

49.89 

•49.89 



44.32 
46.14 
26.79 
27.72 

6.63 
11.07 

5.13 
13.15 
16.95 
15.85 
27.34 
26.89 
38.14 
35.27 
48.25 
48.80 
46.79 
49.14 
49.89 
49.73 
49.97 
49.93 
49.89 



45.68 

48.19 

38.52 

39.71 

28.99 

31.95 

12.41 

8.89 

5.91 

6.30 

13.83 

13.33 

28.37 

25.02 

44.36 

44.42 

40.28 

•46.91 

•48.90 

49.40 

-49.60 

-49.63 

-49.83 

•49.86 



44.64 

48.52 

44.57 

44.46 

38.31 

41.13 

23.93 

23.28 

3.03 

9.18 

0.79 

0.03 

14.68 

9.39 

34.90 

34.35 

31.09 

41.71 

•46.18 

47.56 

•48.76 

•49.14 

49.42 

49.62 



47.01 
49.07 
48.01 
46.36 
46.05 
44.99 
32.59 
32.69 
12.95 
16.96 
11.47 
10.95 
0.27 
2.37 
18.54 
18.51 
18.24 
35.16 
36.98 
40.04 
45.88 
46.29 
•48.45 
48.79 



46.92 
48.74 
48.14 
47.79 
47.44 
47.76 
38.58 
39.88 
18.08 
21.83 
17.45 
19.62 
5.12 
12.05 
6.41 
5.43 
5.14 
23.76 
25.65 
29.68 
39.42 
41.52 
45.06 
46.39 



The figures shown in Table XV form for each elementary 
grade the final measure of the difficulty of any given sentence for 
that grade. If it were not desirable to show the difficulty of 
each sentence for all grades together, we might use the values of 
Table XV without making any further changes in them. In- 
deed, if any person desires to know the difficulty of any sentence 
in Scale A for the fifth grade or for any other elementary grade, 
Table XV gives the necessary data. 

The measurement of the difficulty of these sentences in the 
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TABLE XV 



P.E. Equivaubnt of Diffbrencb Bbtwben 50 Per Cent and Per Cent 
OF Perfect Score Made bt Each Elementary Grade for Each 
Sentence of Language Scale A 



Sentence 


Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


Nc 


». 


II 


III 


IV 


V 


VI 


VII 


VIII 


2 


2x 


-.702 


-1.931 


-2.347 


-2.543 


-2.389 


-2.791 


-2.769 


4 


2y 


-.759 


-2.140 


-2.621 


-3.107 


-3.227 


-3.489 


-3.318 


7 


3x 


1.154 


- .203 


-1.086 


-1.782 


-2.380 


-3.047 


-3.091 


11 


3y 


1.168 


- .228 


-1.131 


-1.876 


-2.365 


-2.659 


-2.983 


22 


4x 


2.261 


1.007 


- .247 


-1.196 


-1.766 


-2.605 


-2.891 


29 


4y 


2.156 


.634 


- .417 


-1.354 


-2.000 


-2.438 


-2.975 


23 


5x 


2.574 


1.048 


.191 


- .468 


- .951 


-1.391 


-1.786 


24 


5y 


2.480 


1.287 


.498 


- .334 


- .921 


-1.396 


-1.890 


27 


6x 


2.935 


1.418 


.650 


.220 


- .113 


- .491 


- .697 


31 


6y 


3.235 


1.645 


.605 


.235 


- .344 


- .650 


- .857 


28 


7x 


3.254 


1.990 


1.112 


.524 


- .030 


- .433 


- .671 


30 


7y 


3.734 


2.066 


1.091 


.505 


- .001 


- .412 


- .762 


37 


8x 


4.437 


3.009 


1.752 


1.164 


.558 


- .010 


- .191 


34 


8y 


4.102 


2.483 


1.554 


1.001 


.353 


- .088 


- .455 


36 


9x 




4.256 


3.129 


2.352 


1.531 


.716 


.239 


43 


9y 




4.720 


3.346 


2.360 


1.495 


.715 


.202 


41 


lOx 




4.568 


2.744 


1.924 


1.307 


.704 


.192 


45 


lOy 




4.568 


3.532 


2.769 


2.055 


1.547 


.943 


49 


Hi 






4.567 


3.395 


2.628 


1.669 


1.031 


52 


iiy 






4.151 


3.725 


2.921 


1.904 


1.231 


53 


12x 






4.880 


3.938 


3.328 


2.576 


1.853 


55 


I2y 






4.720 


3.982 


3.532 


2.646 


2.037 


54 


13x 






4.567 


4.372 


3.744 


3.200 


2.447 


56 


I3y 








4.475 


3.967 


3.341 


2.665 



higher grades is made in exactly the same manner as it was made 
in the elementary grades: the score on each sentence is turned 
into percentages of the perfect score, the differences between these 
percentages and 50 per cent being then turned into P.E. differ- 
ences by means of Table XIII. This assumes, of course, that 
ability to complete sentences is distributed according to the 
normal surface of frequency in each higher grade. The score 
and the P.E. distances from the medians are given in Table XVI 
for the eighth grade and high school classes in those school sys- 
tems where the writer was able to test both the elementary and 
high school classes. The same facts are shown for the group of 
graduate students at Teachers College. 



CaUuialum of the DifficuUy of Teat Sentences 





Grade 


Grade 


Gmd. 


Cndo 


Of.de 


CoHoga 


SutenM 


VIII 


IX 


X 


XI 


XII 






1 


P.E. 


T 


P^. 


T 


-■ 


J. 


P.E. 


I 


P.E. 


J_ 


P.E. 


2 


421 


-2 470 


~ 


-3.498 


334 


-2 BBS 




—3.983 


208 


, 


220 


—2 AM 












BBS 


34( 


-3 


73S 


27( 






2o: 


-3.064 


22f 






43B 


-3.1« 


531 




84( 


34( 




Ta 




































—2 


471 








— 3^891 


























205 


—3 


S32 


22t 












-3 


231 


33( 


-3 




281 


-3 


395 


20 






226 




as 


37! 


-i:4« 








30f 












ISS 










24 
















06 




—2 




1B2 








— .aao 




23S 


















-I 


875 


IB 




89S 


21S 


- 188 


31 




- .9S3 




-1 


3« 


23( 




« 


28! 




16( 












zs 


296 


- ,ft61 




















187 






















2M 








— 1 




177 








— !oio 




244 


"lies 


3M 




so; 


251 




B2' 


isi 




72! 


IS 




227 


is; 




34 


23S 


-1.S2 


346 










17 








179 










sa 








iSE 


















14B 








— 488 






















201 




941 






87) 


21( 


-2.34* 


41 






- .67( 


27! 




014 


21! 




S21 


16! 






15 










IS 


102 
















+ 




















40 


































18^ 


— l!3SS 


S3 






IW)- 


14; 






MS 


ISi 


+ 


ISi 


m 




05! 


11 






204 


-1-SS7 


S3 


It 




2.Mt 


B! 






42; 


11( 


+ 


B8T 


lOt 


+ 


411 




+ 


























+ 






+ 






+ 


























+1 












+1 


27t 


131 


-3.62 


ee 






a 908 


20 




ha 


474 


29 


+2 


037 


45 


+ 1 














No ot 


"i^ 




273 




171 




135 




103 




114 




P.rfMt 


























Soon . 


442 




M8 




342 




272 




206 




228 





4. Measurement of the Distances Between Grades 
There are a number of ways in which the P.E. distances be- 
tween consecutive grades can be measured. Three methods 
have been used in this study and the average of the three has 
been taken as the most probably true measure of the distance in 
each case. 

We have assumed that the ability to complete sentences is 
distributed in any ^ven grade in accordance with the normal 
surface of frequency. The assumption was also made, although 
it was not clearly stated, that each sentence to be completed is a 
test of ability to complete sentences, and that ability to complete 
individual sentences is distributed "normally." Thedifference 
between two consecutive grades may therefore be measured by 
the difference in the positions with reference to the two grade 
medians held by any given sentence. For example, sentenoe 
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No. 2 was, according to Table XV, .702 P.E. below the second 
grade median and 1.931 P.E. below the third grade median, which 
makes a difference of 1.229 P-£« between the medians of the 
second and third grades. This method of determining the 
differences gives us a large number of direct measurements. 
Table XVII gives these sentence measurements of the intervals 
between the consecutive elementary grades. 

TABLE XVII 

P.E. iNTEBYAiis Shown Between CoNBEcxTnyB Elembntabt Grades bt 

Each Sentence of Language Scale A 



Sentence 

No. 


Interval 

ii-ni 


Interval 

m-iv 


Interval 
IV-V 


Interval 
V-VI 


Interval 
VI-VIT 


Interval 
VII-VIII 


2 2x 

4 2y 

7 3x 

11 3y 

22 4x 

29 4y 

23 5x 

24 6y 

27 6x 
31 6y 

28 7x 

30 7y 
37 8x 
34 8y 
36 9x 
43 9y 
41 lOx 
45 lOy 
49 llx 

52 lly 

53 12x 
65 12y 

54 13x 
56 13y 


1.229 
1.381 
1.357 
1.396 
1.254 
1.522 
1.526 
1.193 
1.517 
1.590 
1.264 
1.668 
1.428 
1.619 


.416 

.481 

.883 

.903 

1.254 

1.051 

.857 

.789 

.768 

1.040 

.878 

.975 

1.257 

.929 

1.127 

1.374 

1.824 

1.036 


.196 
.486 
.696 
.745 
.949 
.937 
.659 
.832 
.430 
.370 
.588 
.586 
.588 
.553 
.777 
.986 
.820 
.763 
1.172 
.426 
.942+ 
.738+ 
.195 


-.154 
.120 
.598 
.489 
.570 
.646 
.483 
.587 
.333 
.579 
.554 
.506 
.606 
.648 
.821 
.865 
.617 
.714 
.767 
.804 
.610 
.450 
.628 
.508 


.402 
.262 
.667 
.294 
.839 
.438 
.440 
.475 
.378 
.306 
.403 
.411 
.568 
.441 
.815 
.780 
.603 
.508 
.959 
1.017 
.752 
.886 
.544 
.626 


-.022 
-.171 
.044 
.324 
.286 
.537 
.395 
.494 
.206 
.207 
.238 
.350 
.181 
.367 
.477 
.513 
.512 
.604 
.638 
.673 
.723 
.609 
.753 
.676 


Average. . . 


1.425 


.991 


.671 


.556 


.576 


.401 



A general tendency will be noticed in Table XVII for the 
large differences between grades to appear in the harder sentences. 
I have grouped the measurements of each interval, putting in 
one group those measurements of the interval shown in Table 
XVII which were obtained from values lower than —1.5 P.E. 
in Table XV, in a second group those obtained from values 
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between —1.5 and 1.5 P.E., and in a third group those measure- 
ments obtained from positive values larger than 1.5 P.E. The 
average of each group of measurements for each interval is 
given below in Table XVIII. 



TABLE XVIII 

Averages of Gboups of Dbtbbminations of Intbr-Gbadb Intebyadb as 
Measured bt Sentences of Language Scale A 



Group 


Interval 
ll-lll 


Interval 
III-IV 


Interval 
IV-V 


Interval 
V-VI 


Interval 
VI-VII 


Interval 
VII-VIII 


Below —1.5 
-1.5 to 1.5 
Above 1.5 


1.305 
1.376 
1.558 


.448 

.929 

1.160 


.531 
.669 
.724 


.378 
.537 
.678 


.484 
.511 
.756 


.236 
.339 
.668 



Table XVIII throws some very interesting light upon the 
question of how two grades differ in ability. Evidently one 
grade is better than the grade below both in the difficult and the 
easy tests, but the large differences are in the hard tests. An 
eighth grade child differs from a. seventh grade child more dis- 
tinctly in doing difficult tasks than in doing tasks that are 
moderately easy for both. At any rate, it appears that the 
child in the higher grade shows his superiority in doing harder 
tests rather than in doing the easy tests. 

It hardly seems just to allow the intervals between grades to 
be influenced equally by sentences near the medians of the two 
grades concerned and by other sentences at the extreme ranges 
of the distributions. The sentences near the medians are more 
reliable measures and should probably be weighted, while those 
sentences which are more than 3 or 4 P.E. from the interval 
should possibly not be allowed to influence the measure of the 
interval at all, because at that extreme range caprice and accident 
have undue influence. It also seems unfair, in view of the facts 
shown in Table XVIII, to allow the easy sentences to have the 
same amount of influence as the more difficult in determining 
the intervals between grades. The plan that has been followed 
here has been to allow equal weight to all measures of the interval 
by sentences not more than 2 P.E. below the lower grade of the 
pair nor more than 4 P.E. above the higher grade of the pair 
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whose distance from each other is being measured. The average 
of the measurements by sentences in Table XVII, which lie 
within this range, are given below. 

Grade Interval.... II-III III-IV IV-V V-VI VX-VH Vll-Vin 
P.E. Interval 1 .408 .965 .705 .620 .606 .479 

The intervals between the higher grades derived from the 
sentence locations given in Table XVI are shown in Table XIX, 
with the average of the determinations from sentences within 
the range — 2 P.E. to +4 P.E. 

TABLE XIX 

P. E. Intebvalb Shown Between Conbecuttve Higher Grades bt Each 
Sentence of Language Scale A. (Complete System Group) 



Sentence 


Interval* 


Interval 


Interval 


Interval 


Interval 


No. 


VIII-IX 


IX-X 


X-XI 


XI-XII 


XII-O.G. 


2 


1.025 


-.542 


1.030 






4 


.078 


.749 


- .121 


-.550 




7 


-.344 


.889 


-1.149 






11 


-.200 


.583 


- .764 


1.361 


.059 


22 


.572 


-.993 








29 


1.203 


-.110 


.270 






23 


.475 


-.069 


- .088 


.068 


1.240 


24 


.009 


.296 


.521 


-.375 


.778 


27 


.404 


.589 


.332 


-.177 


.488 


31 


.356 


.178 


.663 


.007 


-.064 


28 


.188 


.339 


.179 


-.052 


.029 


30 


.270 


.138 


.223 


.240 


.413 


37 


.400 


.332 


- .202 


.502 


.288 


34 


.355 


.672 


.116 


.368 


.230 


36 


.624 


.309 


.323 


.138 


.609 


43 


.809 


.237 


.382 


-.070 


1.465 


41 


.684 


.507 


- .077 


.660 


.330 


45 


.657 


.370 


.494 


-.009 


.989 


49 


.808 


.475 


.052 


.545 


.881 


52 


.959 


.792 


.208 


.236 


1.566 


53 


1.122 


.737 


.272 


.143 


.788 


55 


.634 


.928 


.259 


.131 


1.044 


54 


.830 


.712 


.417 


-.329 


1.640 


56 


.434 


.437 


.596 


.188 


1.106 


Weighted 












Average 


.556 


.484 


.265 


.192 


.813 



1 In each of the methods used to determine the intervals between consecutive grades, the 
difference between the eighth grade and the first year high school grade has been based upon 
the difference found in those school systems wliere both elementary and high school classes 
were tested. 

Table XIX has the disadvantage of being based upon the 
small number of pupils tested in those school systems where both 
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elementary and high school grades were measured. Six sentences 
included in this group were also included in some tests given in 
three large city high schools, so that it is possible to get from 
them a measure of the differences between high school grades 
based upon a larger number of pupils, although upon a smaller 
number of sentences. 

Table XX gives the score and P.E. equivalents for these six 
sentences in the high school grades. 

TABLE XX 
Score and P.E. Equivalentb fob Six Sentences in the Higher Grades 





Grade IX 


Grade X 


Grade XI 


Grade XII 


Col. Grade. 


SU>ntp.n(^ 












No. 


t 




8 




8 




8 




8 








P.E. 


P 


P.E. 


§ 


P.E. 


8 


P.E. 




P.E. 






Si 




QQ 




OQ 




QQ 




37 


692 


-.548 


560 


-.763 


630 


-.653 


544 


- .805 


193 


-1.516 


36 


575 


-.132 


542 


-.669 


630 


-.653 


587 


-1.059 


192 


-1.488 


45 


403 


.471 


388 


.065 


491 


-.083 


468 


- .406 


189 


-1.409 


49 


335 


.727 


378 


.111 


489 


-.075 


477 


- .451 


187 


-1.358 


55 


124 


1.777 


190 


1.065 


293 


.728 


320 


.316 


149 


- .585 


54 


53 


2.447 


101 


1.702 


142 
470 


1.531 


157 


1.227 


136 


- .362 


No. tested 


537 




402 






385 




114 





The averages of the six determinations from Table XX of the 
intervals between grades, I have calculated to be as shown in the 
second line below. 

IX-X X-XI XI-XII XII-C.G. 

Language Scale A 484 .265 .192 .813 

Six Sentences 538 .119 .329 .923 

Average to use 511 .192 .260 .868 

The third line shows the intervals which will be used as probably 
the most accurate determinations from sentences. 

A second method of determining the intervals between grade 
medians makes use of the quartile as a measure of the P.E. If 
Scale A were perfect and if the surfaces of distribution in Figs. 
8 to 14 were perfectly normal, the quartile, which is half of the 
range of the middle 50 per cent, would have been exactly the 
same as the P.E. Since we are assuming in the other determina- 
tions that completion-test surfaces of distribution are approxi- 
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mately normal, no great error will result from doing so in this 
case. I have therefore averaged the quartiles of each two con- 
secutive grades and used this average as a diviser of the crude 
score interval between the grade medians. Table XXI shows 
the result upon the data furnished by Table I. 



TABLE XXI 

Dbtbbmination of the Quabtilb Intebyaus Between Elbbcbntabt 

Grades 





Grade 
II 


Grade 
III 


Grade 
IV 


Grade 
V 


Grade 
VI 


Grade 

vn 


Grade 
VIII 


Median Score . . . 
Quartile 


4.5912 
2.0848 


8.9864 
3.4127 


14.3287 
4.1567 


18.3888 
3.6140 


21.9175 
3.6098 


25.2719 
3.7496 


28.0598 
4.0412 


Score Interval 


4.3952 
2.7487 


5.3423 
3.7847 


4.0601 
3.8858 


3.5287 
3.6119 


«5 .<5044 

3.6797 


2.7879 
3.8954 




Average Quartile 




Quartile Interval 


1.5990 


1.4115 


1.0450 


.9769 


.9116 


.7157 





Table XXII furnishes the same information regarding the 
quartile intervals between the higher grades, from the data 
given in Table III. 



TABLE XXII 

Determination of the Quartile Intervals Between Higher Grades 

(Complete Stbtem Group) 





Grade 
VIII 


Grade 
IX 


Grade 
X 


Grade 
XI 


Grade 
XII 


College 
Gradu- 
ates 


Median Score 

Quartile 


27.8611 
3.6882 


30 . 1470 
4.2317 


33.6818 
3.8992 


35.7272 
3.3718 


37.1666 
3.8437 


42.8125 
2.8660 






Score Interval 


2.2859 
3.9599 


3.5348 
4.0654 


2.0454 
3.6355 


1.4394 
3.6077 


5.6459 
3.3548 




Average Quartile 








Quartile Interval 


.5772 


.8695 


.5626 


.39ft9 


1.6^20 
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The third measurement of the differences between successive 
grades is also based upon the distribution of scores in Language 
Scale A. It will be observed in Table I that many second grade 
pupils received scores greater than the median score for the 
third grade, and that many third grade pupils received lower 
scores than the median second grade score. Between the third 
grade median, which is 8.9864, and the second grade median, 
which is 4.5912, there are (if we assume that the scores of the 
children recorded as making a given score are spread evenly 
over that step) 531.96 of the 131 8 individuals in the second grade 
distribution and 545.58 of the 1437 individuals in the third grade 
distribution. In terms of percentages, 37.96 per cent of the 
third grade distribution and 40.36 per cent of the second grade 
distribution lie between the medians of these two grades. Each 
of these percentages is a percentage from the median of the 
distribution and may therefore be turned at once into a P.E. 
value by means of Table XIII. This transmutation reveals 
a difference between the medians of the second and third grades 
of 1. 931 P.E. when measured by the second grade distribution, 
and 1.739 when measured by the third grade distribution. 

It is also possible by this method to obtain certain indirect 
measures of the same distances. 47.66 per cent of the fourth 
grade distribution, for example, lies between the fourth grade 
median and the second grade median, so we may say (from 
Table XIII) that in so far as it is measured directly by the 
fourth grade distribution the second grade median is 2.948 P. E. 
below the median of the fourth grade. In the same way, 31.55 
per cent of the fourth grade distribution lies between the median 
for that grade and the median for the third grade, which makes 
a P.E. difference of 1.332 between the two grades. From the 
median of the fourth grade distribution, then, we have found it 
to be 2.948 P.E. to the second and 1.332 P.E. to the third grade 
median, and by subtraction this gives us a difference between the 
second and third grade medians of 1.6 16 P.E. 

It would be possible, of course, to derive indirect measures 
of each interval from any distribution of scores which covers the 
interval, but it would be unfair to allow these indirect measure- 
ments, especially those which are very near the extreme ranges 
of a distribution, to have the same influence as the direct measure- 
ments. Since the intervals have already been determined by 
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two other methods, it seemed best to give full weight here to 
direct determinations by this method and one-half weight to the 
indirect determinations obtained from the distribution next above 
the pair furnishing direct determinations and one-half weight 
to the indirect determination obtained from the distribution 
next below the direct pair. 

Table XXIII gives for each elementary grade distribution 
the percentages of the distribution lying between its median 
and the medians of the two grades lower and of the two grades 
higher, and the P.E. equivalents of these percentages as taken 
from Table XIII. 



TABLE XXIII 

Percentages of Each Elementabt Gbade Distribution Lying Between 
Its Median and the Medians of Neighboring Grades, with P.E. 
Eqxtivai^ntb 





Percentacea and Equivalenta of Peroentaces of Distribution of 


To Median 
of Grade 








Grade 
II 


Grade 
III 


Grade 
IV 


Grade 
V 


Grade 
VI 


Grade 
VII 


Grade 
VIII 


Grade 
IX 


II 




37.96% 
1.739 


47.66% 
2.948 












III 


40.36% 
1.931 




31.56% 
1.332 


46.70% 
2.726 










IV 


48.30% 
3.146 


30.45% 
1.272 




28.07% 
1.148 


40.82% 
1.973 








V 




43.43% 
2.237 


23.94% 
.951 




23.62% 
.937 


38.91% 
1.812 






VI 






39.33% 
1.845 


24.35% 
.970 




23.13% 
.910 


36.28% 
1.621 




VII 








40.15% 
1.914 


^:Sir« 




'»:Jjr- 


30.16% 
1.257 


VIII 










'I:f2? 


18.78% 
.726 




X3.04Ji 



As indicated above, the direct determinations are given twice 
as much weight in this study as the indirect values, and the only 
indirect values used are those from the distributions immedi- 
ately above and below the grades concerned. Table XXIV 
shows the values used. 
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Determinationb of the Intbr-Grade Intervals Obtained from Over- 
lapping OF Distributions of Scores on Language Scale A 



Determination 


II-III 


III-IV 


IV-V 


V-VI 


VI-VII 


vii-vin 


Lower Indirect . . 
Lower Direct . . . 

Upper Direct . . . 

Upper Indirect. . 


1.931 
1.931 
1.739 
1.739 
1.616 


1.215 
1.272 
1.272 
1.332 
1.332 
1.578 


.965 

.951 

.951 

1.148 

1.148 

1.036 


.894 
.970 
.970 
.937 
.937 
.902 


.982 
.982 
.910 
.910 
.879 


.747 
.726 
.726 
.742 
.742 
.763 


Average 


1.7912 


1.3335 


1.0331 


.9350 


.9345 


.7410 



Table XXV gives data similar to Table XXIII but with refer- 
ence to the higher grades in those schools where the entire school 
system was tested. The distributions of scores in Langus^ 
Scale A upon which Table XXV is based will be found in Table 
III. 

TABLE XXV 

Percentages of Each Higher Grade Distribution Ltino Between Its 
Median and the Medians of Neighboring Grades, with P.E. 
Equivalents 



To Median 
of Grade 


Distribution of 


Grade 
Vll 


Grade 
Vlll 


Grade 
IX 


Grade 
X 


Grade 
XI 


Grade 
Xll 


Grade 
C.G 


VIII 

IX 

X 

XI 

Xll 

C.G. 


17.12% 
.667 


16.29% 
.624 


14.44% 
.549 

20.39% 
.796 

31.32% 
1.319 


1:g? 

24.66% 
.984 


16.04% 
.614 

7.23% 
.270 

41.63% 
2.047 


21.76% 
.863 

33.92% 
1.470 





The averages of the weighted direct values and the unweighted 
indirect values obtained from Table XXV, as illustrated in Table 
XXIV, are as follows: 
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Interval VHI-IX EX-X X-XI 

Average 5853 .8803 .5068 



xi-xn xn-c.G. 

.3091 1.5678 



Half of the sentences in Language Scale A were included in a 
test given in two high schools where the elementary grades had 
not been tested. The sentences included in this high school test 
were selected, one sentence from each grade-pair in Scale A, so 
that the entire test had practically the same difficulty but was 
just half as long as Language Scale A. By going through the 
records and finding what score each student in the higher grades 
would have made if tested on these twelve sentences only, I was 
able to get a distribution of scores in each of these higher grades 
which had the advantage of larger numbers of pupils, although 
there were fewer sentences. Table XXVI shows the total dis- 



TABLE XXVI 
Distribution of Scores Made in High School Half Test 




Score 


Grade 
IX 


Grade 
X 


Grade 
XI 


Grade 
XII 


CoLGrads. 


24 


1 

1 

10 

9 

16 

27 

29 

24 

24 

32 

32 

24 

21 

10 

6 

5 

2 

1 


3 

6 

8 

9 
11 
24 
17 
22 
30 
25 
17 
15 
10 

8 

3 

2 

2 
........ 


2 
1 

16 

14 

34 

42 

53 

31 

34 

39 

21 

17 

15 

12 

4 

2 

2 

1 


5 

6 

12 

19 

24 

28 

33 

27 

19 

31 

12 

11 

6 

1 

2 

1 


13 


23 


17 


22 


23 


21 


13 


20 


15 


19 


12 


18 


11 


17 


6 


16 


2 


15 




14 




13 


1 


12 




11 


1 


10 




9 




8 




7 






6 






6 








4 












3 












2 












1 





































No. tested 


273 


213 


340 


237 


114 






Median Score 


15.14 


16.78 


17.74 


18.26 


21.69 
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tribution of scores made in this high school half-test by the pupils 
in Grade IX and above, whether they took it in the short form 
or as a part of Scale A. 

From this table I have worked out the distances between grade 
medians in exactly the same way as they were derived above, 
with the following results: 

X-XI XI-XII XU-C.G. 



As being probably the truest value for the intervals as deter- 
mined by this method, I have taken the average of the determina- 
tion by the small number of pupils with Scale A and the deter- 
mination by the larger number of pupils with half of Scale A. 



Intervaa VIII-IX IX-X X-XI 

FVom Scah A S853 .8803 .6068 

From half Scale A. . .6968 .3828 

Av. Det^mmatioD 

of Difltnbutioiu. . .6863 .7885 .4448 



xi-xn XII-C.G. 
.30gi 1.5678 
.2468 1.8054 



1.6866 



Values for the intervals between grade medians having now 
been worked out by three different methods, it is interesting to 
note that although the three determinations differ somewhat, 
their general characteristics are the same. It would be difficult 
to determine which method furnishes the best results. I have 
simply taken the average of the three results for each interval as 
the one to be used in this study. The results of each method 
and the average result are given in Table XXVII. 



Thhkb Detbruinationb I 



TABLE XXVII 
p THc Intbbval BEnraiN SuccnasirB Oradbb 



Method 


Interval Between Grades 


S 


I 


: 


S 


Z 


2 


t 





s 


1 


iS 


Sentence 

Distribution . . . 

Quartile 


1.408 
1.791 
1.599 


.966 
1.333 
1.411 


.706 
1.033 
1.045 


.620 
.935 

.977 


.606 
.934 
.912 


.479 
.741 
,716 


.656 

.586 
.677 


.611 

.788 
-889 


.192 
.445 
.563 


.260 

.277 
.399 


.868 

1.687 
1.683 


Average uaed aa 
thefinal meas- 


1.509 


1.237 


.928 


.844 


.817 


.645 


.673 


.723 


.400 


.312 


1.412 
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5. Selection of a Zero-Poixt for Completion-Test Abiuty 

Zero-points are absolute on some scales and aiiritrary on others. 
It would be very hard to select a sentence so easy that to be 
unable to complete it would signify that one had absolutely no 
" language ability, " so it will be necessary to choose an arbitrary 
zero-point for these tests if they are to be called "Language 
Scales. " It will still be posable, however, to locate a zero-point 
which will represent absolute inability to complete any printed 
sentence as difficult as the easiest one used in the tests included 
in this study. 

Reference to Table I shows that 255 of the 1318 children in 
the second grade made a score of o in Scale A, which means that 
they received no score at all. Between these children and the 
median of the second grade, however, there were 404 children, 
which is 30.65 per cent of all in the second grade. Reference to 
Table XIII shows that a difference of 30.65 per cent from the 
median of a normal distribution means a distance of 1^83 P.E. 
If this were our only evidence, therefore, we might locate our 
arbitrary zero-point at i .283 P.E. below the median of the second 
grade. 

Table I also shows that 19 of the 1437 pupils in the third grade 
made a score of zero, while 48.68 per cent scored above zero but 
below the median of their grade. This would locate the zero- 
point in Scale A at 3.291 P.E. below the third grade median. We 
have already determined (Table XXVII) that the third grade 
median is 1.599 P.E. above the second grade median. The 
zero-point in Scale A is therefore located by the third grade 
distribution at 1.692 (3.291 — 1.599 = 1.692) P.E. below the 
second grade median. 

The median score of the second grade on Language Scale A is 
shown by Table I to be 4.5912, and the quartile 2.0848. Assum- 
ing that the quartile is equal to the P.E., as it is in a perfectly 
normal surface of frequency, we find by dividing the score by the 
quartile that the second grade median is 2.2022 P.E. above zero. 

The median score of the third grade is shown by Table I to be 
8.9864. Table XXI shows the average of the quartiles of grades 
II and III to be 2.7487. Dividing the score by this average of 
the quartiles places the third grade median at 3.2693 P.E. above 
zero. From this determination, then, zero would be 1.670 
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(3.269—1.599 = 1.670) P.E. below the second grade median. 
This makes the fourth determination of the distance from zero 
to the second grade median. The four determinations are as 
follows: 

From the second grade distribution 1 .283 

From the third grade distribution 1 .692 

From the secona grade score 2 .202 

From the third grade score 1 .670 

Average 1.712 

It would be very convenient in any scale for ability of any sort 
to have at least one test located exactly one unit above the zero- 
point. The easiest sentence in Scale A is shown by Table XV 

to be sentence No. 4, **We are going school." 

. After accepting tentatively the determination just made that 
the second grade median is 1.7 12 P.E. above the zero-point, the 
location above zero of sentence No. 4 was worked out according 
to the scheme to be described below. It was found that, under 
these conditions, this sentence No. 4 had a value of 1.018 above 
zero. This was so near i .000 that it was decided to employ 
such a value for the distance between zero and the second 
grade median as would place sentence No. 4 exactly at i P.E. 
above zero. 1.687 P.E. was found to be such a value. This 
is only .025 P.E. smaller than the average of the four deter- 
minations made above and is probably just as near the true 
distance. 

For the purposes of this study, then, zero will be defined arbi- 
trarily as I P.E. below sentence No. 4, or as i .687 P.E. below the 
median of the second grade distribution shown in Table I.^ 

Having located our zero-point at 1.687 P.E. below the second 
grade median, and having previously determined the distances- 
between the medians of each consecutive grade, it is now an easy 

^ It must be borne in mind that this is not a zero-point for language ability 
or even for completion-test ability, but merely the zero-point tor ability to 
complete the printed sentences used in this study. The zero-point for ability 
to complete a spoken sentence would probably be found several units below 
the zero-point used in this study. The absolute zero-point for ability^ to 
complete the easiest possible incomplete idea or representation of an object 
would probably be found still further down on an absolute scale, below even 
the zero-point for ability to complete a spoken sentence. If scales are ever 
constructed for these simpler forms of completion test, we may expect the zero- 
point established in this study to be located several units above the zero-point 
lor these simpler tests. 
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matter to calculate the distance of each grade above zero. 
These distances are shown in Table XXVIII. 

TABLE XXVIII 
DiBTANCBS Above Zbbo of ths Medians of EIach School Gbadb. 1 *P JS. 



Grade 


Above Zero 


Below Next Grade 


II 


1.687 


1.599 


III 


3.286 


1.237 


IV 


4.523 


.928 


V 


5.451 


• O'X'X 


VI 


6.295 


.817 


VII 


7.112 


.645 


VIM 


7.757 


.573 


IX 


8.330 


.723 


X 


9.053 


.400 


XI 


9.453 


.312 


XII 


9.765 


1.412 


CO. 


11.177 





Fig. 17 (page 55) represents the relations of the grade medians 
to each other, to the zero-point, and to the distributions of 
other grades, upon the assumption that ability in each grade is 
distributed in accordance with the normal surface of frequency, 
and that the values given in Table XXVIII are substantially 
correct. 

6. Referring All Sentences of Scale A to Zero 

Table XV gave the value of each sentence of Language Scale 
A for each elementary grade, and Table XVI gave their values 
for the higher grades. In Table XV, for instance, sentence No. 
7 had a positive value of 1. 154 in the second grade and a value 
of — .203 in the third grade. Now we know from Table XXVIII 
that the second grade median is at i .687 P.E. and the third grade 
median at 3.286 P.E. above zero. 1.154 added to 1.687 gives 
this sentence a value of 2.841 above zero in the second grade, 
while .203 subtracted from 3.286 gives it a value of 3.083 above 
zero in the third grade. Table XXIX (page 56) is made from 
Table XV by employing in this way the values given in Table 
XXVIII for each grade median. 
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TABLE XXIX 



Location Above Zero of Each Sentence of Language Scale A forEIach 

Elementary Grade. 1>bP.E. 



Sentence 
No. 


Grade 
II 


Grade 
III 


Grade 
IV 


Grade 
V 


Grade 
VI 


Grade 
VII 


Grade 
VITI 


2 2x 

4 2y 

7 3x 

11 3y 

22 4x 

29 4y 

23 6x 

24 6y 

27 6x 
31 6y 

28 7x 

30 7y 
37 8x 
34 8y 
36 9x 
43 9y 
41 lOx 
46 lOy 
49 llx 

62 lly 

63 12x 
66 12y 

64 13x 
66 13y 


.986 
.928 
2.841 
2.866 
3.948 
3.843 
4.261 
4.167 
4.622 
4.922 
4.941 
6.421 
6.124 
6.789 


1.366 
1.146 
3.083 
3.068 
4.293 
3.920 
4.334 
4.673 
4.704 
4.931 
6.276 
6.362 
6.296 
6.769 
7.642 
8.006 
7.864 
7.864 


2.176 
1.902 
3.437 
3.392 
4.276 
4.106 
4.714 
6.021 
6.173 
6.128 
6.636 
6.614 
6.276 
6.077 
7.662 
7.869 
7.267 
8.056 
9.090 
8.674 
9.403 
9.243 
9.090 


2.908 
2.344 
3.669 
3.676 
4.265 
4.097 
4.983 
6.117 
6.671 
6.686 
6.976 
6.966 
6.616 
6.462 
7.803 
7.811 
7.376 
8.220 
8.846 
9.176 
9.389 
9.433 
9.823 
9.926 


3.906 
3.068 
3.915 
3.930 
4.529 
4.296 
5.344 
6.374 
6.182 
6.961 
6.266 
6.294 
6.853 
6.648 
7.826 
7.790 
7.602 
8.360 
8.923 
9.216 
9.623 
9.827 
10.039 
10.262 


4.321 
3.623 
4.065 
4.463 
4.607 
4.674 
6.721 
6.716 
6.621 
6.462 
6.679 
6.700 
7.102 
7.024 
7.828 
7.827 
7.816 
8.669 
8.781 
9.016 
9.688 
9.768 
10.312 
10.463 


4.988 
4.439 
4.666 
4.774 
4.866 
4.782 
6.971 
6.867 
7.060 
6.900 
7.086 
6.996 
7.666 
7.302 
7.996 
7.969 
7.949 
8.700 
8.788 
8.988 
9.610 
9.794 
10.204 
10.422 


Grade Position. . 


1.687 


3.286 


4.623 


5.451 


6.296 


7.112 


7.767 



Table XXX shows the location above zero of each sentence in 
Language Scale A for each higher grade in the schools where both 
elementary and high school classes were tested. Table XXX is 
derived from Table XVI by employing the grade locations shown 
in Table XXVIII. 

The number of pupils in each of the higher grades which fur- 
nished the data for Table XXX was small, and yet these pupils 
were slightly more able than the pupils in the same grades of the 
large city high schools where a short completion test was given. 
This means, probably, that for high school students in general 
the values assigned in Table XXX are too low. 

Six of the sentences actually were included in both sets of tests, 
and the location of each of these six sentences for each of the 
higher grades was shown in Table XX. Table XXXI gives the 



CaUsulatum of the Difficulty of Test Sentences 

TABLE XXX 



57 



Location Aboyx Zbro of Each Ssntbncs or Languaob Scalb A for 
Each Highbr Gbadb (Complstb System Gboup.) 1— PJB. 





Sentence 
No. 


Grade 
IX 


Grade 
X 


Grade 
XI 


Grade 
XII 


Grade 
Col. Gr. 




2 


4.835 
5.344 

5.484 
5.678 

5.095 
5.095 

6.356 
6.561 

7.376 
7.021 

7.491 
7.334 

7.735 
7.823 

8.221 
8.000 

8.316 
8.765 

8.925 
9.275 

9.754 
10.107 

10.408 
10.804 


6.100 
5.318 

5.318 
5.818 

6.179 
5.928 

7.148 
6.988 

7.510 
7.566 

7.875 
7.919 

8.126 
7.874 

8.635 
8.486 

8.532 
9.118 

9.173 
9.206 

9.740 
9.902 

10.419 
11.090 


5.470 
5.839 

6.867 
6.982 

4.853 
6.058 

7.636 
6.867 

7.578 
7.303 

8.096 
8.096 

8.728 
8.158 

8.712 
8.504 

9.000 
9.024 

9.521 
9.506 

9.868 
10.043 

10.402 
10.894 


6.701 

5.933 
5.933 

7.880 
7.554 

8.067 
7.608 

8.460 
8.168 

8.538 
8.102 

8.886 
8.886 

8.661 
9.345 

9.288 
9.474 

10.037 
10.224 

11.043 
11.018 


8.493 




4 






7 


7.658 




11 


7.286 




22 






29 






23 


8.052 




24 


8.188 




27 


8.991 




31 


9.084 




28 


9.843 




30 


9.167 




37 


9.662 




34 


9.284 




36 


9.689 




43 


8.833 




41 


9.743 




45 


9.768 




49 


9.819 




52 


9.320 




53 


10.661 




55 


10.592 




54 


10.815 




56 


11.324 









location above zero of each of the six sentences for each high 
school grade, first as calculated from Table XXX, and second as 
determined from the larger number of pupils reported in Table 
XX. Table XXXI also shows the amount of difference between 
the two values for each sentence and the average amount of 
difference caused by the larger numbers from the city high schools. 
In order to correct the values shown in Table XXX for the 
slightly extraordinary abilities of the pupils from whom it was 
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TABLE XXXI 



Ohanqbs in Valttbs Aboyb Zbro of Six Sbntbncjds bt Ubm on Liowum 

NuMBEBS OF High School Students 



H.S. 


No. 
PiipilR 


Sentence No. 


Average 
Differ- 
ence 


Grade 


37 


36 


45 


49 


55 


54 


IX 


273 
537 


7.735 
7.782 


8.221 
8.198 


8.765 
8.801 


8.925 
9.057 


10.107 
10.107 


10.408 
10.777 




X 


Diff. 

171 
402 


.047 

8.126 
8.290 


-.023 

8.635 
8.384 


.036 

9.118 
9.118 


.132 

9.173 
9.164 




9.902 
10.118 


.369 

10.419 
10.755 


.093 


XI 


Diflf. 

136 
470 


.164 

8.728 
8.800 


-.251 

8.712 
8.800 




9.024 
9.370 


-.009 

9.521 
9.378 


.216 

10.043 
10.181 


.336 

10.402 
10.984 


.076 


XII 


Diff. 

103 
385 


.072 

8.538 
8.960 


.088 

8.886 
8.706 


.346 

9.345 
9.359 


-.143 

9.288 
9.314 


.138 

10.224 
10.061 


.582 

11.043 
10.992 


.180 




Diff. 


.422 


-.180 


.014 


.026 


-.143 


-.051 


.014 



derived, .09 was added to all values for grade IX, .07 to all grade 
X values, .15 in grade XI, and the values in grade XII were not 
changed at all. These corrections were determined by refer- 
ence to the average differences shown in Table XXXI . 

Having now located by each grade the distance above zero for 
each sentence of Scale A, we may undertake to determine what 
the location of each sentence is for school children in general. 
It will be noticed in Table XXIX that there is a tendency for 
each sentence to have a higher location in the higher grades than 
it has in the lower grades. This is probably due in part to the 
presence in these higher grades of a few inferior individuals, who 
fail to make satisfactory completions of sentences which should 
be easy for them. It would be unjust, however, to allow the few 
dull pupils who manage to get into the higher grades to keep on 
dragging these easy sentences into the higher ranges of the scale. 
Undoubtedly the most reliable distribution for determining the 
general difficulty of a sentence is the distribution whose median is 
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nearest to the position of the sentence. I have therefore given 
double weight to the determinations by those grade distributions 
whose medians were not more than i P.E. from the sentence's 
location, and single weight to all determinations by grades more 
than I P.E. but less than 2.5 P.E. from the sentence. 

Fig. 18 shows how a grade distribution would affect sentences 
at various distances. 




'Ur.L -IPC. M. ♦Itt. .♦2JK. 

Fig. 18. Showing the Influence Allowed Various Parts of a Distribution in 
Determining the General Location of a Sentence. 

The determination of a distribution is given double weight if its median 
is within i P.E. of a sentence, single weight if more than i and less than 
2.5 P.E., and no weight at all in the general determination if its median 
is mbre than 2.^ P.E. from the sentence. Areas a and / are not allowed to 
help determine the general difficulty of a sentence. 

Table XXXII shows for the first five sentences the details of 
just how the weighting was done. 



TABLE XXXII 

DSTBBMINATION OF GsifBBAL LOCATIONS OF SSNTBNCBS 



Distribution 


Sentences No. 


2 


4 


7 


11 


22 


n 

III 

IV 

V 

VI 

VII 


.985 
.985 

1.355 
2.176 


.928 
.928 

1.146 


2.841 

3.063 
3.063 

3.437 

3.669 
3.915 


2.855 

3.058 
3.058 

3.392 

3.575 
3.930 


3.948 

4.293 

4.276 
4.276 

4.255 

4.529 


Average 

Use 


1.376 
1.38 


1.000 
1.00 


3.338 
3.34 


3.311 
3.31 


4.263 
4.26 







6o CompUtion-Test Language Scales 

Weighting in this manner the values shown in Tables XXIX 
and XXX (after raising the values of Table XXX by the amounts 
determined in Table XXXI), the figures obtained to show the 
general difficulty of each sentence for all grades are shown in 
Table XXXIII. 



TABTiE XXXm 




AL Values of Sentences 


IN SCAL 


Sentence 


General 
Value 


4 
2 


1.00 
1.38 


11 
7 


3.31 
3.34 


29 
22 


4.12 
4.26 


23 
24 


5.40 
5.69 


31 
27 


6.50 
6.67 


30 
28 


6.95 
7.04 


34 
37 


7.31 
7.85 


43 
36 


8.29 
8.32 


41 
45 


8.37 
9.04 


49 
52 


9.20 
9.29 


53 
55 


10:05 
10.19 


54 
56 


10.76 
11.17 



^ Sentences are here in the order of difficulty, not the order of Scale A. 
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7. Estimation of the Difficulty of Other Sentences* 

Scale A is the basis upon which all values are built in this 
study. The Graded Series of test sentences was given to a 
smaller number of children and was not given to the College 
Graduate group, so there are two corrections to be made in the 
figures obtained directly from its use: a correction must first be 
made for any difference in the abilities of the groups which are 
called by the same grade number, and a second correction must 
be made in the values of the more difficult sentences for the lack 
of the College Graduate group. The other lists of tests outside 
of the Graded Series require the same corrections, except that 
in the cases of these others the second correction is not simply for 
the lack of one grade group but for the lack of several such groups. 

Lack of sufficient numbers of children tested to actually locate 
the difficulty of a test can not be corrected, except by testing a 
sufficient number of children. The writer feels that the irregu- 
larities due to small numbers are negligible in the sentences of 
Scale A, very small in the other sentences of the Graded Series, 
somewhat larger in the sentences numbered from 57 to 72, and 
still larger in those sentences numbered higher than 72. For the 
sentences numbered above 56, it can only be said that their diffi- 
culty has been estimated carefully, although much more statistical 
labor has been spent upon them than upon the sentences of Scale 
A. To actually measure the difficulty of a sentence requires 
that it be tried upon hundreds of children in each grade. No 
amount of calculation can take the place of large numbers of 
children tested. 

Table XXXIV gives the score made upon each sentence of the 
Graded Series in each school grade. Table XXXV gives the P.E. 
equivalents of the score, and Table XXXVI gives the resulting 
location above zero of each sentence. 



1 Other sentences than those included in the Language Scales are not given 
in the body of this report, but each sentence used in this investigation, together 
with the scheme used in scoring it, will be found in the Appendix. 
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TABLE XXXIV 
SooRii Madb bt Each Gkadb on Each Ssmtkncb or thb Gradxd S 



S>Dle»« 


GnKk 


G^t 


gI^ 


Grade 


Grsde 


"^^ 


Grade 


Crad. C 


nde 


G^ 


Ctiid* 


No. 


" 


III 


IV 


^ 


VI 


VII 


VIII 


IX 


X ° 


XI 


XII 


J 


soo 


"istir 


IssT 


467 


1M2 


~~207~ 


874 


384 


'liT 


2„ 


163 




970 


1346 


1283 


422 








81 


236 


211 


166 


3 


676 


10B6 




273 


1003 


I2i 


832 




233 


































lO&A 


















164 




eea 




1270 


476 


114S 


320 


888 


83 


242 




ISS 


7 
















73 




201 




















72 








e 


TOO 


7M 


888 


330 


1014 










207 


163 


10 


SM 


707 


933 


273 


1068 


70 


859 


77 


34 


206 


163 


11 
















366 


37 


201 




















70 






16S 


IB 


183 


603 


809 


163 


1003 


57 


868 


363 




10 


1S4 


U 


318 










061 


784 


354 


229 




160 
















799 




30 






18 


1S7 


603 


IB 












33 




161 


17 


348 


02 




238 


1038 


166 


861 


374 


238 


12 


1S6 


18 














805 


374 


236 








339 
















32 


202 






ise 


1& 


900 


192 




101 








200 


lea 


31 




B23 






eso 


102S 


788 


369 


34 


300 


180 


















376 








33 


53 


37 


SO 














80 




H 


70 


361 


307 


793 


75S 


924 


783 




22 


204 


166 














846 


666 


206 


01 


60 


125 


IS 




33S 


463 


720 


















Zfi 


ass 


30 


SS6 


567 


807 


604 








147 


3B 




13 


348 


468 


631 


678 


603 


365 


88 


73 


133 


as 


40 


460 












37B 


38 






so 


8 


M 


340 


SI 7 










S3 






11 


IS 






m 


633 


664 


660 






98 


161 


83 
















167 


27 




103 


U 




14 
















21 




u 


s 


AS 


137 


207 


414 


564 


651 










u 


6 








344 


664 


60S 


339 


77 


62 


128 


aa 
















;476 


22 


^342 




ST 




a 


88 


223 


324 














88 








81 


184 


373 


341 








•308 


30 












343 


376 


•430 


51 


•287 


■300 


M 








61 








;4S2 






•345 


!5 






"t 


77 


120 


273 


1 
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•285 


•287 
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31 


-34S 


•365 








30 


53 


88 










• 55 




4G 












154 


333 








•30T 


















•333 




• 61 


•303 










19 


30 








52 


•363 


;286 


48 








a 


IS 








334 


■202 
















103 


168 




272 


•220 


•397 










20 








•206 


284 


;2i9 


;24» 


ei 








7 


IS 














sa 










17 


4B 


99 


•214 








63 
H 








' 






24 


■162 


188 


■186 


■ns 


GS 








2 




32 


64 


•los 






•203 


fiS 












3 






•49 


•71 


•BT 


Niunbsr 


770 


770 


095 


758 


57S 


S16 


444 


102 


121 


los 


83 


(mtfld... 
















•456 


310 


■336 


•aao 


Ptriecc 


IMO 





1300 
















1S« 


Scon.. 
















•912 


820 


■472 


•468 
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TABLE XXXV 

P.E. EquiVALKNTO OP DtFFKBENCE Betweeh 50 Per Cent and Pes Cent or 
Pkbpect Scorx Made bt Each Gkade ros Each Sbntxnci 

OF THE GkADED SeKIEB 



"ns"- 


"If 


Qnda 
III 


"vt 


a-.. 


VI ° 


Qnd< 
VII 


Gnd< 
VIII 


Ondc 
IX 


"f 


Qndc 
XI 


"xT? 


1 

SI 

1 

as 

1 
i 

3S 

38 
SO 

ii 

40 

i 

M 

IS 


~ '.X 
I'.X 

'. i 

'. i 

'.Si 

'. 
"a 
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3.64 


1 
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3 


91 

8; 

°'. 
ot 




3 
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SI 

BO 
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-"1 
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32 
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1 

as 
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TABLE XXXVI 



BsDlence 
No. 


"T 


°.7f 


Grade 


Grade 


Grade 


Grade 


Gradr 


Gmde 


Grade 
X 


Grade Grade 
XI XII 


20 

1 

i 
i 

i 

as 

40 
43 

i: 

i 

i 




i 

SI 

BO 
80 
M 

io 

20 

ii 

as 


1.33 

if 

3;i9 
3:z2 

if 

si 

il 
II 
il 

?l 
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! 
8 

7 
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! 


SO 
35 

ea 
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1 

3a 

98 

se 
:s 

i 
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i 

i 

;s 

83 

8| 

4S 

00 

i 


9 
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72 

1 

98 

as 

i 

5a 

39 
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1 

as 
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33 
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i-i 
i| 
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J 
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53 
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86 
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m 
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9S 
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98 

1 

38 


5' 49 
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1 

:97 
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'1 

:a5 

11 

.:s7 
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■1 
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7a 

i 

23 

go 

23 

*6 

4S 

7a 

i 

i 

J5 
34 

1 

01 

78 
68 


e 


i 

48 
32 

SI 
12 

IS 

80 

i 

72 

M 

?S 

1 
1 

67 

78 




i 

04 

112 

i* 
90 

S2 

19 

32 
*6 

J3 
19 
iS3 

i 

M 

30 

25 

la 
w 

la 

99 


I 


«0 

ao 

83 

i 

29 

i 

91 

a 

p 

07 

i 

i 
s 

38 
40 

OS 

1 


°?s..„ 


,,» 


3.29 


..„ 


.... 


6.29 




,.,. 


..» 


.„ 


.... 


9.76 



The corrections for the results of the Graded Series, to com- 
pensate for the low ability shown by those who were tested with 
the entire Graded Series as compared with those tested by Scale 
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A only, are determined from Table XXXVII, which shows the 
differences, for each sentence of Language Scale A, between the 
results obtained in the Graded Series alone and the results ob- 
tained from all pupils who were tested with the sentences of 
Language Scale A. Table XXXVII is obtained by taking the 
difference on each sentence between the values shown in Table 
XXXVI and those shown in Tables XXIX and XXX. 



TABLE XXXVII 

Changb of Location Abovb Zbro Madb m Each Sbntbncb of thb 
Graded Sbribs bt its Inclusion in Lanouagb Scalb A 



Sentence 


Gnule 


Grade 


Grmde 


Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


Gradt 


No. 


II 


III 


IV 


V 


VI 


VII 


VIII 


IX 


X 


XI 


XII 


2 


—.22 


—.24 


—.16 


—.26 





.11 


.04 


.16 


.02 


—.01 




4 


-.28 


—.27 


—.36 


—.38 


—.21 


—.23 


—.14 


—.02 


—.00 


.06 


.05 


7 


—.12 


—.11 


—.18 


—.00 


—.10 


—.06 


.02 


.07 


—.00 


—.02 




11 


—.00 


—.16 


—.23 


—.22 


—.16 


—.26 


—.18 


—.08 


—.16 


.00 


—.11 


22 


—.66 


—.12 


—.10 


— .31 


—.36 


—.10 


—.24 


—.14 


.10 




—.11 


23 


—.14 


—.16 


—.37 


—.34 


—.43 


—.43 


— .26 


—.10 


—.00 


.17 


—.05 


24 


.06 


—.13 


—.34 


—.27 


— .34 


—.30 


—.13 


.06 


.06 


.20 


.02 


27 


—.16 


—.03 


—.12 


—.20 


—.16 


—.24 


—.01 


—.06 


.12 


.11 


.10 


28 


—.26 


—.10 


— .26 


—.22 


—.10 


—.24 


—.03 


-.02 


-.04 


.13 


—.05 


20 


—.60 


—.13 


—.24 


—.17 


—.12 


—.10 


—.02 


.03 


.13 


.68 




30 


—.00 


.04 


-.31 


—.10 


—.31 


—.23 


—.11 


.03 


-.03 


.11 


.10 


31 


—.22 


—.07 


—.11 


—.26 


—.20 


—.60 


—.33 


.23 


.26 


.23 


—.16 


34 


.02 


—.23 


—.36 


—.27 


—.18 


—.26 





.01 


.10 


.10 


—.01 


36 




.31 


—.13 


—.80 


—.14 


—.43 


—.26 


—.06 


.03 


.23 


.82 


37 




—1.27 


—.62 


—.40 


—.31 


—.20 


—.10 


—.04 


—.06 


-.03 


-.02 


41 






—.20 


—.60 


—.66 


—.44 


—.42 


—.31 


—.21 


.10 


—.40 


43 






—.60 


—.60 


—.37 


—.38 


—.10 


—.14 


.27 


.11 


.25 


46 






—.66 


—.06 


.03 


—.16 


—.01 


—.01 


.06 


.26 


.25 


40 






—.03 


—.87 


—.66 


—.37 


—.84 


—.06 


r-.12 


—.06 


.11 


62 






—.46 


.00 


—.20 


—.60 


—.67 


—.04 


.07 


— .11 


.04 


63 








—.33 


—.30 


—.16 


—.12 


.08 





.16 


.22 


64 












—.62 


—.42 





—.03 


.20 


.04 


66 








—.62 


—.40 


—.46 


—.14 


.01 


—.12 


.06 


.11 


66 










—.63 


-.03 


—.27 


—.00 


.02 


.06 


—.04 


Below — 1. 




—.26 


—.26 


—.22 


—.17 


—.16 


—.11 


+ .02 


+ .02 


+ .16 


+ .08 


—1. to +1. 


—.26 


—.13 


—.22 


—.24 


—.26 


-.31 


—.16 


—.06 


.00 


+ .08 


+ .04 


Above +1. 


—.20 


—.17 


—.36 


—.38 


—.41 


—.46 


-.31 


—.01 









The changes indicated in Table XXXVII are not averaged as 
they were in the case of Table XXXI, but are grouped according 
to the nearness of the median of the distribution concerned to the 
sentence in question. All changes upon sentences more than i 
P.E. below the median are put into one group, all those upon 
sentences from i P.E. below to i P.E. above are put into another 
group, and those upon sentences more than i P.E. above are 
put into a third group, and each group is averaged. The aver- 
ages of the groups are then used to correct the values of the 
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sentences which were not given in Scale A, the corrections being 
applied within the same limits as were used in obtaining them. 
The result of employing these aver^^e changes as corrections is 
shown in Table XXXVIII. 



TABLE XXXVra 



ESTIMATKD 


Location 


Above Zbro of Each Sbntbhcb 
Gbadbd Sbbibs Oni-t 


Given q 


THE 


BaDUDM 

No. 


Grxfc 


UI* 


Grade 
IV 


°r 


"yf 


VIl' 


vni' 


IX 


x' 


XI ^ 


*^xTf 


I 

6 
6 

3 
fi 
SS 

s 

47 

i 


! 

a 

3 

a 


97 

se 
ee 

i 

09 


S 

a 
a 
a 

7 

7 


OS 
78 

i 

S4 

M 
77 

63 
72 
72 


e 

! 

1 


34 

26 
24 

64 
40 

30 

B4 
14 

06 

28 
6S 

43 

77 


also 

3. 2 

3. B 

4:m 
4:42 
4:28 
sis 

.3 

:e 

.6 

:7e 

!S9 

.a 




S6 

73 

04 
26 

07 

74 

76 

as 

54 

00 

63 


1 


02 
40 
80 
36 
31 
49 

44 

52 

es 


1 

1 


47 
77 

04 
04 

7S 

80 

S3 
90 

es 

68 


£ 


74 

08 
68 

24 

68 
OS 

00 

1 

43 

1 
1 


i 
s 


SI 

60 
26 
34 
72 

06 

63 

34 

72 
80 


1 


78 
09 

7T 
00 

01 

67 
34 

1 

12 

1 

SO 




68 
44 

as 
se 
33 
44 

si 

32 

02 

75 

1 

i 



The general difficulty of the Graded Series tests was calculated 
from Table XXXVIII in exactly the same way as the general 
values of the sentences ia Scale A were calculated from Tables 
XXIX and XXX. 

The amount of compensation for the lack of the College Grad- 
uate group was determined by finding what the value of the more 
difficult tests in Scale A would have been if the values from this 
superior group had not been used in calculating the general 
difliculty of the sentences. It was found that the College Grad- 
uate group had not influenced the general value of any Scale A 
sentence receiving a general value of less than 6.00 P.E. The 



CalcuUUion of the Difficulty of Test Sentences 67 

sentences which without the C.G. group would have been located 
between 6.00 and 7.00 had been raised on the average .16 P.E. 
by the use of the C.G. group. Those sentences which had re- 
ceived between 7.00 and 8.00 had been raised .13; between 8.00 
and 9.00, .08; between 9.00 and 10.00, .07; and above 10.00, .07. 
These averages were therefore applied as corrections to the gen- 
eral determinations for the Graded Series sentences, each aver- 
age being applied to the range within which it had been found. 
Tlie final values obtained after all the corrections had been 
made are shown in Table XXXIX. 

TABLE XXXIX 
Final Values of Sbntbncbs Givbn in the Graded Series Only 

Sent. No. Value 

1 .96 

3 3.33 

6 2.52 

6 1.98 

8 2.94 

9 3.76 
10 3.41 

12 3.58 

13 4.03 

14 4.88 

15 4 .81 

16 4.16 

17 3.66 

18 4.42 

19 4 .47 

20 4.09 

21 4.40 

25 6.32 

26 7.00 

32 8.91 

33 8.38 
35 7.42 

38 8.42 

39 8.58 

40 8.46 
42 8.86 
44 8.95 

46 9.04 

47 9.03 

48 9.50 

50 9.28 

51 9 .78 



M 



T«K Sm» Mjm 'uy £4A 



5^ 



III 



IT 



VI 




2 
4 
7 
11 
22 
2i> 
» 
24 
27 

» 

as 
4:a( 

41 
45 
40 

i» 
i» 

M 



2^ 


k:^ 


741 


IMI 


ia» 


1731 


att 


TfA 


7m 


Iflg3 


1231 


ITS 


241 


438 


710 


1044 


Ul» 


174* 


224 


424 


n4 


UK 


I3ri» 


1747 


]2» 


^12 


C7<l 


IMS 


]3a& 


174A 


l4Sf 


!^Vi 


Ml 


Stt 


13^ 


1744 


lU 


424 


j» 


«M 


1203 


1404 


1^ 


7m 


522 


M3 


1179 


h:3 


V7 


m 


365 


«5 


fl!B 


U» 


s . 


771 


303 


eM 


«^ 


1317 


M 


1» 


34ft 


519 


W> 


11S& 


42 


2» ; 


358 


«EM 


S?7 


13» 


2% 


lat ' 


217 


373 : 


7S 


1000 


42 


173 


2» 


44d . 


775 


1086 


■ 


25 


73 


163 1 


535 


&1S 



2 
2 ^ 



25 
46 
15 
2 
6 
1 
2 
3 



» 

130 

34 

21 

5 

7 

7 

5 

2 



17* 



«12 



81 
52 
30 
16 

7 
7 
6 



514 
219 
216 
1&5 



460 
476 



71 
33 
24 



201 

154 

115 

72 



No. iMUd 



57 
56 
50 
60 
61 
02 
63 
64 
65 
66 
67 
68 

m 

70 
71 
72 



No. \MkUA^ 



151 



356 



381 



d4Sf 



6n 



801 



55 
86 
8 
19 
45 

78 
13 

7 
22 

2 
20 

5 
33 



266 

295 

08 

134 

239 

21 

266 

132 

19 

93 

109 

43 

157 

20 

74 

97 



449 
479 



341 
447 

54 
483 
314 

44 
266 
319 

91 
264 

72 
195 
229 



658 
742 
423 

dvv 

729 
73 
786 
496 
109 
488 
576 
192 
482 
130 
391 
361 



950 
1053 
782 
942 
1060 
253 
1055 
882 
315 
751 
891 
419 
769 
385 
683 
642 



1317 
1475 
1145 
1363 
1556 

478 
1556 
1388 

582 
1115 
1375 

726 
1173 

674 
1124 

943 



100 



268 



367 



617 



643 



865 



* Soffit chfldrtfi did not have a cbmnoe to complete the tentenoet on the laat 
ftiientlon wm not called to the fact that it contained eentencet. 
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The remaining lists of tests were treated in the same manner 
as the Graded Series. The corrections to be made for differences 
of ability were derived by examining the behavior of the sentences 
of Language Scale A, which were always given with the new 
sentences in order to obtain just these comparisons. Correc- 
tions for the lack of grade groups were made by finding what 
would have happened if these grade groups had not been used in 
making up from Tables XXIX and XXX the final measure of 
the difficulty of the sentences of Scale A. 

The following tables give merely the score made on each sen- 
tence, the number of pupils tested, and the final position assigned 
to the sentence.^ In those cases where a sentence appeared 
in two different lists and therefore has two estimates of its 
final position recorded in the following tables, it will be well 
in practice to make use of the arithmetic average of the two 
determinations. 

TABLE XLI 
EsTDfATKD Final Valubb of Ssntbncbs in Intebmediatb School Sebibs 

Sent. No. Value 

67 6.98 

68 6.66 

69 7.46 

60 6.83 

61 6.86 

62 8.92 

63 6.64 

64 7.02 
66 8.74 

66 7.40 

67 6.93 

68 8.28 

69 7.16 

70 8.60 

71 7.64 

72 7.66 



^ To show here the individual steps taken with each ^up of sentences would 
require the printing of an enormous quantity of statistical tables and would 
add nothing to the value of this study. The same methods and the same care 
were employed to secure accurate results as in the case of the sentences of the 
Graded Senes. Publication of the scores made on these sentences will make 
it possible for other investigators to use my results in any way that may seem 
desirable. 
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TABLE XLII 
Score Made on Each Sentence of High School Short Test 



Sentence 


Grade 


Grade 


Grade 


Grade 


No. 


IX 


X 


XI 


XII 


2 


160 


98 


60 


40 


4 


160 


100 


60 


39 


7 


158 


100 


60 


40 


11 


160 


100 


58 


40 


22 


162 


97 


60 


40 


29 


160 


98 


58 


40 


23 


156 


95 


53 


40 


24 


145 


92 


67 


37 


27 


132 


83 


55 


33 


31 


122 


78 


54 


40 


28 


125 


84 


50 


34 


30 


126 


83 


61 


32 


37 


114 


80 


41 


29 


34 


110 


77 


47 


36 


36 


99 


70 


40 


23 


43 


111 


65 


46 


30 


41 


92 


65 


39 


33 


45 


64 


51 


34 


21 


49 


64 


67 


31 


25 


52 


48 


50 


37 


31 


53 


24 


33 


18 


18 


55 


18 


44 


25 


17 


54 


8 


16 


4 


9 


56 


16 


14 


10 


10 


78 


29 


35 


20 


22 


79 


73 


63 


36 


23 


80 


69 


64 


36 


27 


81 


75 


65 


35 


25 


82 


37 


29 


26 


19 


83 


25 


27 


15 


18 


84 


12 


19 


13 


13 


85 


8 


8 


4 


2 


86 





4 








87 


15 


12 


12 


7 


88 


15 


17 


5 


7 


89 


1 


1 


1 





No. tested 


81 


50 


30 


20 
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TABLE XLIII 
EsmiATED Final Valubb of Sentences in High School Shout Test 



Sent. No. 

78 
79 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 



Value 

9.63 

8.91 

8.59 

8.92 

9.76 

10.20 

10.53 

11.58 

12.65 

10.75 

11.14 

12.31 



TABLE XLIV 
Scores Made in High School Halp Test 





Sentence 


Grade 


Grade 


Grade 




No. 


X 


XI 


XII 




4 


84 


400 


264 




7 


82 


401 


268 




22 


82 


397 


264 




24 


76 


372 


241 




27 


75 


333 


237 




30 


73 


340 


230 




37 


55 


276 


194 




36 


50 


248 


187 




45 


30 


179 


140 




49 


39 


238 


155 




55 


15 


114 


100 




54 


10 


51 


51 




70 


68 


323 


223 




65 


49 


252 


187 




79 


44 


263 


190 




90 


7 


73 


48 




91 


28 


118 


89 




92 


26 


158 


104 




93 


27 


179 


125 




94 


51 


210 


182 




95 


46 


264 


211 




78 


12 


68 


77 




82 


37 


165 


136 




83 


12 


37 


45 




84 


7 


52 


36 




96 


16 


70 


66 




97 


10 


42 


38 




No. tested 


42 


204 


136 
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TABLE XLV 

EsTDfATED Final Valxtbb of Sbntbncbs in High School Halt Tb8t 

Sent. Value 
No. 

70 7.33 

65 8.03 

79 8.05 

90 10.79 

91 9.88 

92 9.71 

93 9.53 

94 8.15 

95 7.94 

78 10.65 

82 9.37 

83 10.90 

84 11.17 

96 10.48 

97 11.11 



TABLE XLVI 

Scores and Ebtdcates of Final Values for Second Grade East Test 

Sent. Value Score 
No. 

73 1.18 475 

74 1 .28 436 

75 1 .63 353 

1 468 

2 427 

4 469 

76 1 .97 302 

77 1.09 429 

3 308 

5 276 

6 324 
8 138 

10 172 

7 115 

11 75 
29 54 



Calculation of ike Difficulty of Test Sentences 



73 



TABLE XLVII 
ScoBis^ Madb on IinsBMBDiATB Gradb Hau^Tut Sbntbnces 



Sent. 


Grade 


Grade 


No. 


VII 


VIU 


98 


333 


888 


99 


208 


296 


100 


103 


171 


101 


287 


315 


102 


344 


380 


103 


82 


126 


104 


68 


133 


106 


274 


357 


106 


270 


351 


107 


251 


321 


108 


59 


72 


4 


400 


459 


7 


402 


453 


22 


400 


446 


24 


361 


413 


27 


231 


301 


30 


278 


318 


37 


207 


249 


36 


88 


121 


45 


54 


80 


49 


40 


78 


55 


14 


25 


54 


6 


16 


No. tested 


207 


232 



> The final ralues of these tentenoei were not estimated, bnt the aooRt 
order that anyone who withe* to estimate their difficulty may have the 



are gfren here in 
data. 
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APPENDIX 

I. CORRELATIONS 

The writer of this monograph has not as yet undertaken a syrstematic 
study of the correlations shown by the language scales presented here. Such 
a study needs to be made, however, before it will be possible to say just how 
these tests are related to other tests of knowledge and ability. Such correla- 
tions as are reported here have been worked out incidentally, sometimes at 
a matter of curiosity and sometimes in connection with other studies. They 
are reported here merely to show the need that exists for further investigation. 

Simpson, ^ who made a very thorough investigation of the correlations of 
intellectual tests, including the paragraph completion test, which he calls the 
Ebbinghaus test, has this to say with regard to the reliability of the completion 
test (p. 48) : "Test XIV, Ebbinghaus mutilated test, was very high in reliability 
as used, easily the highest of all. The coefficients of correlation between the 
two halves of the test are: .96 for the Good, .93 for the Poor, and .92 for all 
together. It is beyond question a good test, and should be perfected and 
standardized, with a considerable number of specimens graded in difficulty." 

Simpson estimates (p. 63) the true correlation between the Ebbinghaus test 
and the other tests used in his study as follows: Ebbinghaus test correlates 
with Hard Opposites .85, with Memory of Words .82, with Easy Opposites 
.72, with A Test .54, with Memory of Passages .71, with Adding .65, with 
Geometrical Forms .36, with Learning Pairs .60, with Completing Words .60, 
with Drawing Lengths .15, and with Estimating Lengths .33. His corrected 
coefficient for the correlation between the Ebbinghaus test and Estimated 
Intelligence is .89 (p. 75). 

The Language Scales proposed in this report differ somewhat from the 
paragraphs used by Simpson in his study, and the correlations he has reported 
would probably not apply exactly to the tests used in this study. Although 
the writer is inclined to believe that the sentence tests are more accurate and 
that the correlations with them will be even higher than those shown with 
the paragraph tests, a thorough study of the correlations of the sentence tests 
is the only way in which this belief can be proved or disproved. Such a study 
will undoubtedly be made very soon. In the meantime the following results 
are suggestive of the sort of correlations we may expect. 

In an unpublished study of the mental abilities of dependent children in 
certain institutions,* the "preliminary list" of completion-test sentences men- 
tioned on page 4 was given, along with the Binet-Simon tests, the Stenquist 



1 B. R. SimiMon: Correlationa of Mental AbOitlei. Teacberi CoUese Contributions to Bdn- 
catioo. New York. xpia. 

'Since the above section was written, this study has been published in the Archives of Pj3f- 
ekology. No. 33. Sept.. ipzs* J* L. Stenquist, B. L. Thorndilce, and M. R. Trabue: The Intel- 
Icctoal Sutus of ChUdxen who are Public Charses. 
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tests of mechanical construction ability, and certain other tests. Before 
sending in the report of the results, the writer worked out a few coefficients 
of correlation ^ with two groups of children. In a group of 50 boys and girls, 
ages 10-16, the completion-test sentences gave a coefficient of .74 with the 
Binet tests, and .46 with the Stenquist test, which showed a coefficient of 
.62 with the Binet test. With a group of 39 boys, ages 10-16, the results were 
as follows: 

Completion tests with Binet tests, f » .85 
Completion tests with Stenquist tests, f » .59 
Stenquist tests with Binet tests, f * . 58 

In a certain seventh grade class of 30 children, in which some of the graduate 
students at Teachers College made a number of tests. Language Scale A made 
coefficients as follows: 

with English Composition (Hillegas Scale), r-> .72 
with Courtis Problems in Division, r» .04 

with Thomdike's Reading Scale Alpha, r» .47 
with Thorndike's Reading Scale A, 1^^ -49 

In the sixth grade of 33 pupils, where the writer gave a number of tests, the 
results were as follows: 

Language Scale A 

with teacher's estimate of intelligence, r» .74 
with Wood^ Multiplication Test, r>B .51 

with Courtis Multiplicati n Test, r^ — . 12 

with Thomdike's Scale Alpha, v* "■ • 47 

In a second sixth grade of 29 pupils, the results of certain tests were combined 
and the correlation worked out between the combined scores and the scores 
in Language Scale A. The results were as follows: 

Language Scale A 

with Combmation of all marks made in one semester at school, ra .49 
with Combination of Thomdike's Scale Alpha, Buckingham's 

Spelling Scale, and Hillegas's Composition Scale, f » .58 
with Combination of Vocabulary Test, Opposites Test, 

Mixed Relations Test, and Proverbs Test, ''"■•39 

As indicated above, these coefficients are not numerous enough or reliable 
enough to prove anything conclusively. They do suggest, however, that there 
is a positive and rather intimate relation between ability to complete sentences 
and ability in other tests of language and general intelligence. 



> Snoe there was good evidence that none of the testa used were evenly craded as to difficulty. 
It seemed best to use Spearman's formula, which takes into account only the relative positioas 
oi the individuals in the different tests. This formula, which is given on page z68 of Thorn- 
dike's Mental and Social Measurements, is as follows: 

A. T ~ ^^ - The p values are then converted into r values by means of the table given 
^ ii(n«-x) 

by Thomdike. which shows the r value for each possible P value as derived trom the formula 



r^a sin 



f')- 
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One rather surprising correlation has been reported to me by Professor W. D. 
Scott, of Northwestern University. Thirty efficiency experts employed by 
a large industrial concern in New England were tested by Dr. Scott, who used 
ten different tests, including a list of completion-test sentences prepared by 
the writer. Each member of the firm who knew the thirty experts made a list 
of them, arranging them in order according to his judgment of their efficiency 
as efficiency experts. Professor Scott mailed a list of the men, ranked according 
to the results of his ten tests, and on the same day the members of the firm 
mailed their lists to him. Professor Scott's combined results gave a coefficient 
of .87 with the combined judgment of the employers. The completion test, 
which was only one of the ten tests, had a coefficient of .64 with the employers' 
combined judgments, and with the combined result of all ten tests, rB.69. 



2. SCHEME FOR SCORING SENTENCES 

The question of what should be called correct and what should be called 
incorrect in scoring the sentences as completed is a question upon which a great 
deal of time and worry may be spent. The important thing about scoring 
the sentences, however, is not that the scheme used shall be absolutely per- 
fect, but that the scheme used shall be used consistently. 

These sentences might be used to measure a great variety of qualities in 
the individual completing them. For example, we might score altogether 
according to the correctness of the grammatical forms used. On the other hand, 
we might ignore grammar altogether and make these sentences test the child's 
understanding, scoring according to the child's grasp of the ideas suggested 
by the printed words. We might score according to the judgment shown 
or the truthfulness of the child's statements in the sentences as completed. 
Again, it might be possible to use these sentences as tests of memory for 
phrases, of richness of associations, of unity and clearness of expression, of 
aptness in the choice of words, of imagination, or of other characteristics. 

The scheme that has actually been used has not been any particular one of 
the above possibilities, but simply a general combination of all of them. In 
some cases one element may have predominated in causing a decision, and 
in other cases another element. No one needs to follow the scheme shown 
below if he finds it wrong, for it is only given in order that it may be perfectly 
clear just which combinations were allowed and which were not allowed in 
this study. The important things for one to do are to be sure that he is 
making no great errors in judgment, to be consistent, and to report just how 
he did score each sentence. The writer suggests that the detailed scheme 
shown on the following pages be used as it stands in so far as possible, in order 
to secure uniformity and comparability.^ 



^Vfith the preliminary series, 5 points were given for perfect, 4 for slii^tly less than perfect. 
3 for still less, etc. The present scheme (a-i-o) is practically the same as though the lower end 
of the older scheme (5-4-3-a-X'O) had heen omitted, using a in place of 5. x in place of A, and 
o in place of 3, a, i and o. With 40 pupils in each grade, the correlation between the relative 
difficulty of the preliminary-list sentences in the 6A grade and their relative difficulty in the 8B 
grade was .965 by the s-o method. .962 by the a-o method now used, and .958 if everything 
now scored a and x were called " right," and everything else " wrong." 



8o CompletianrTest Language Scales 

The folbwing genei^ acheoie has been the baab upon whkfa the more 
judgments have been baaed: 

GrNBSAL f^CHRMB 

Score 2 

A score of 2 points is to be given each sentence completed perfectly. Eirors 
in spelling, capitalization, and punctuation should not be allowed to affect the 
score. 

Score I 

A score of i is to be given each sentence completed with only a slight im- 
perfection. A poorly chosen word or a common grammatical error, which 
makes the sentence less than perfect and yet leaves it with reasonably good 
sense, should serve to reduce the score from 2 to I. 

Score o 

A score of o is to be given if the sentence as completed has its sense or con- 
struction badly distorted. A sentence must have reasonably good meaning 
and express a sentiment which might honestly be held by an intelligent person 
in order to receive a higher credit than zero. 



DbTAILBD SCHKIIK 

In those sentences having only one blank to be filled, any word appearing 
under the heading Score 2 was considered entirely satisfactory as a completion 
of the sentence. Those words appearing under the heading Score i were 
given half credit — a score of i — ^while the words appearing under Score o were 
given a score of o. The score of each sentence should be written on the test 
paper just under or at the end of the sentence. 

In those sentences where more than one blank appears, the different groups 
of words appearing below are arranged in their proper order and are connected 
by a dotted line to show the proper sequences: the first group on the left 
hand side of the page being words for the first blank in the sentence, and the 
dotted line showing what words are used in the next blanks to make up a 
combination of the value shown by the heading Score 2, Score z, or Score o, at 
the case may be. The commas are used merely to separate the fillers for 
the same blank and are not a part of the completion. An asterisk following 
a bracketed group of words indicates that this group of words will be indi- 
cated thereafter by an asterisk alone. Double asterisks, triple asterisks, etc., 
are also used to refer to and stand for entire groups of words. This device 
obviates the necessity of repeating an entire list of words for each combin- 
ation in which the list may be used. 

The lists given in the following pages are not exhaustive, but they are 
suggestive of the way the scoring has been done. In many cases a different 
tense of the same word has not been recorded. Anyone who uses this scheme 
will be called on constantly to make judgments upon new combinations. 




LANGUAGE SCALE B 

I. We like good boys girls. 

Score 2 

and, an, und, 
Score J 

or, not, and good, also. 
Score o 

for, with, said the, and the, 

6. The is barking at the cat. 

Score 2 

dog, hound, 
Score I 

dogs, boy, dog. 
Score o 

man, cat, god, 

8. The stars and the will shine tonight. 

Score 2 

moon. 
Score I 

light, planets, lights. 
Score o 

dipper, stripes, clouds, city, sky, sun, 

02. Time often more valuable money. 

Score 2 

is, was, .... than, 
Score I 

seems, becomes, .... than. 
Score o 

arte .... with, is • • . . with, 

^3. The poor baby as if it were sick. 

Score 2 

cries, cried, acts, acted, \ ^ ( very, getting, \ ^^ 
lies, lay, looks, looked, J \ quite, extremely, / 

Score I 

sufiFers, su£Fered, appears, moans, sighs, \ ^^ 
lays, feels, behaves, was crying, groans, J ** " ' 
acts, looks, plays, never, 

(feeling, nearly, dangerously, rather, almost, 
real, awfully, terribly, pretty, half, home, 
sea, bad, atx>ut, often, so. 
Score o 

* . . . . not, was .... very. 

Si 



82 



Completion-Test Language Scales 



31. She if she will. 

Score 2 

can, may, 
Score I 

will, may go, can do well, 
Score o 

does, works, goes, has, is, could, knows, might, plays, is good» can't, 

35. Brothers and sisters always to help 

other and should quarrel. 

Score 2 

I try, strive, offer, seek, 
agree, endeavor, learn, aim, ^ * . . each . 
attempt, want. 
Score I 

must .... * each **, 



not 
never. 



should 



J consent, like, go, work, love, 1 u ♦♦ 

\^ be ready, come, have, wish, J 



be ready, come, have 
expected, able, supposed, told, 
glad, happy, willing, eager, ready, 
bade, careful, good, apt, trying, 
together, best, needed, 

. * the, an, one, one an, ••, 

. have .... each ....**, 
. to try each **, 

* Aorh ** 

• • • ■ WOwil • • • • ^ 

. ♦ out, along, some, **, 



** 



** 



38. 



are. . . . 

should . 
nearly . 
ought . 
most . . 
Score o 

should . 

can .... go .... one 

are .... ready .... one .... 

have had each ♦*, 

are .... kind .... each .... **, 

weather usually a good effect 

one's spirits. 

Score 2 

Cold, Pleasant, Balmy, Frosty, 

Winter, Bright, Clear, Moderate, 

Brisk, Spring, Fair, Cool, Mild, 

Warm, Autumn, Beautiful, 
Score I 

* had ♦♦ 

Summer, Good, Fine, Nice, The, Hot, Sunny, 

Calm, Rainy, Temperate, This, Such, Damp, 

Windy, 

* takes, produces, **, 

Summer, Good, .... has ....**, 



.... C8I C 1 1 • ■ • ■ f 



) 



• • . . fl ap • • . 



on, 
upon. 



has . . . . 



have. . . (a, the^* . . . which . . 



•• 
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Score 

*, Summer, Damp, Bad, has, is, to, in, 

* . . . . makes, shows, **, 

* gives to. 

Bad .... has .... **, 

48. It is very annoying to toothache, 

often comes at the most time imaginable. 

Score 2 

trying, unexpected, absurd, 
inconvenient, embarrassing, 
annoying, unwelcome, unusual, 
distressing, extraordinary, 
disagreeable, inopportune, 
undesirable, unfortunate, 
unsuitable, unreasonable, 
^ objectionable, 

suffer from, with, .... which **, 

Score I 

get, feel, su£Fer, bear, * which ♦♦, 

horrid, awkward, terrible, crit- 
ical, unpleasant, busy, strange, 
important, unthinkable, pe- 
culiar, unlucky, harmful, val- 
uable, strange, unlikely, un- 
satisfactory, unprepared, un- 
certain, awful, queer, 

have * for it, as it, and it, that, ft, **, 

Score 

have * and **, 

have. ....... .which. . . . ( :"^T"' ^^T^' ^^^' 

{ joyful, worst, sudden, 

54. To friends is always the it takes. 

Score 2 

' 'k-* I, 1 u' r * worth \ time, effort, trouble, \ •• 

gain, De, neip, iceep, 1 

Score I 

see, satisfy, meet, greet, know, please, find, \ , ^^ 

treat, visit, entertain, possess, obtain, / ' 

* worth endeavor, energy, pains, patience, work. 

Score 

* for, worthy of, **, 

win better longer, 

our given . . . .best. 



have 
suffer 



....♦, \ 

g* / . . . . which .... 
. . . .irom, J 



LANGUAGE SCALE C 

fi. The sky blue. 

Score 2 

is, was, became, turned, looks, appears, seems, 
Score I 

got, is very, is not, is, as, has. 
Score o 

are, light, very, dark, 

5. Men older than boys. 

Score 2 

are, act, look, appear, seem, 
Score I 

grow, were, 
Score o 

De, see, 

112. Good boys kind their sisters. 

Score 2 

are .... to. 
Score I 

were, must be, should be, will be, act, b, .... to, 

are .... with, toward, like, also, and, 

and .... love, think .... of , do things for, 

say words to. 

Score o 

are .... for, as, by, 

19. The girl fell and her head. 

Score 2 

hurt, injured, bruised, cut, hit, struck. 
Score I 

bumped, knocked, came down on, cru|ftied, fractured, broke. 
Score o 

split, busted, on, bunked, 

04. The rises the morning and at 

night. 

Score 2 

sun in, during, .... sets, sinks, disappears. 

Score I 

temperature .... in .... falls, 

boy, bird, .... in .... sleeps, rests, 

«4 
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tide .... in .... also, falls, 

Ifalb, goes, leaves, lowers, sits, moon, never, 
goes down, set, not, descends, drops, dies, 
the moon, fades, 
Score o 

sun .... in ... . sometimes, 
sun .... every .... sets, 

30. The boy who hard do well. 

Score 2 

works, tries, studies, thinks, will. 

Score I 

tries .... can, may, does, shall, should, could, must, 

worked, tried, did, will, can, 

plays, hits, work, will. 

Score o 

tries sometimes, surely, often, 

did work did, does work, work .... did, 

37. Men more to do heavy work 

women. 

Score 2 

f able, competent, willing, 1 ^ . 

Cm V ....1... ■ • a.. 1 f .... Ulill l, 

^ inclined, apt, ready, hkely, J 

have .... ability, strength, inclination, power, than. 

Score J 

prepared, anxious, eager, liable, fitted, 

equal, accustomed, suited, satisfied, fit, 

are ^capable, used, adapted, wanted, re- 

I quired, taken, healthy, qualified, built, 

\ stronger, suitable, useful, 

, / ambition, energy, time, \ . 

nave ....\ . ., •i.^i.* >.... tnan 

^ muscle, tools, right, business, j 

try, like, ought, .... often .... than, 

earn .... money than, has .... ability than, 

know how .... than, eat .... food .... than, 

need toob, money, than, appear * than, 

Score o 

are made, asked, good, active than, 

are useful, able, for, work hard .... than, 

do thinking than, have brains, work than, 

44. The sun is so that one can not 

directly causing great discomfort to the 

eyes. 

Score 2 

brilliant, dazzUng, K f look, gare, K, . ^^^^. 

radiant, bnght, J \ stare, J 



• • • • 



than. 
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96, strong, Bght, \ „ _^ .. ... ^ 

', hot, red, fiery, high. / " ' ■ " **• " '*• " •'*'*^*'"*' 



Score I 

blinding, intense, 
powerful, glary, 

* endure, bear, stand, its rays without, 

* ** into, toward, towards it .... without, 

*, blinding, intense, ** at .... it unless, for, if, 

low .... read .... a book without, 

* even look up .... without. 

Score o 

warm, far, low ** at it without, 

* ** at .... it because, thus, 

.... it .... so ... without, 



** 



53. The knowledge of use fire is of 

important things known by but unknown 

animals. 

Score 2 

yy^ru ^^ «no / ^^^» vcidsiy , \ ^ / man, men, us, \ ' 
now . . . . to . . . one . , . \ , >*...X «., i> 

\ several, J \ mankind, people, j 

f to, by, \ »»» 

\ among, J ' 
Score I 

how to ... . one * persons, scouts, humans, ***, 

Whv we one * ** *** 

when, having, the way, to one * ** ***, 

how to considered, rated, thought, * ** ** 

how to one most ** ***, 

Store o 

how to often * ** *** 

*u^ f proper, correct, careful, \ » »^ ^^^ 

\ important, skillful, great, j 
knowing how to one *....**.. 



*** 



*** 



56. One ought to great care to the right 

of , for one who bad habits 

it to get away from them. 

Score 2 

form, choose, 

acquire, gain, 

cultivate, 

develop, adopt, 

establish, 

learn, teach, 
, begin, 
has, gains, contracts, 
forms, acquires, 
contracts. 



, take, \ 
rcise, / 



use 
exercise 



** 



/sort, \ 
' ' \ kind, / 



♦♦♦...habits 



*4t* 



*** 



{hard, 
difficult, / ♦♦ 



:,} 
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♦..♦♦..habits 



Score I 



living, life, 
working, work, 
studying, study, 
speaking, speech, 
thinking, thought, 
learning, mind, 
procedure, action, 
^ attention, acting. 



^^^ • • • ^ ... xxuus ... ^^ 



obtain, get, 
possess, use, 
have, pursue, 
^ make, lead. 



[♦♦♦.... habits 1 

• • • . ^ ♦♦♦ 

[ habits.... ♦♦♦ 



*** 



♦♦ finds *** 



• ♦♦ ♦♦♦ habits 



**♦*. gets, 



.finds. 



/ impossible. 



*** 



** 



avc, 1 ,, j 
»ve, J J 



{has, \ 
makes, J 



make.. ' ^^^ 

.... habits I ^^^ 

habits.... ♦♦♦ J 

habits *** 1 ^ 

##4t y .... .... nnos .... . . , 

♦♦♦....habits/ 

LttKC .... UBC .... .... spcccH .... .... unuo .... f 






have 
give 



Score o 



*** 



be ♦♦♦ oerson finds 



*** 



*• 



1^ manhood, J 



begin .... way living ♦ J^ finds 






do thing course ♦J* finds ^**, 



do .... ♦♦♦. . . . things *** finds 






/get ... . start .... life 1 . . .♦♦♦. . . . finds . . . .♦7, 
\ do thing life j 



LANGUAGE SCALE D 

4. We are going school. 

Score 2 

to, through, toward, before, after. 
Score I 

into, from, to the, as a, 
Score o 

at, in, 

76. I to school each day. 

Score 2 

go, come. 
Score 1 

am, am going, like to go. 
Score o 

like, to, going, 

II. The plays her dolls all day. 

Score 2 

girl, child, baby, with. 

Score I 

boy, girb, cat, dog, children, little girl, .... with. 
Score o 

girl .... to, for, 

01. The rude child does not many friends. 

Score 2 

have, make, gain, win, 
Score I 

deserve, find, know, acquire, possess, keep, greet, appreciate, 

accumulate, help, please, obey, meet, get, see. 
Score 

want, like, care for, need, has, 

63. Hard makes tired. 

Score 2 

work / ^°®' people, you, him, her, 1 • 

" * * \ me, men, women, them, us, J 
Score I 

work a man, minds, bodies, 

traveling, tasks, luck, things, *, 

Score o 

thing, bread, times, *, 
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Qj. It is good to hear voice friend. 

Score 2 

, , fa, one's, our, your, my, another, \ * 

{ some, his, her, any, then*, J 

Score I 

the of one, an old, a true, the, an intimate, 

your .... my dear, good, her to ... . her, 

a . . . . from, of, a, your, her, .... calling .... your, her, 

your .... again, tonight, my, that .... of ... . my» 

Caruso's .... with his, her .... said .... Mary's, 

Score 

the from *, your with, than, .... your, 

one's said .... his, a .... of, from, .... your, 

his .... and .... his, 

71. The happiest and contented man is the one „ 

lives a busy and useful 

Score 2 

(most, best,)* (who, that,)** life. 

Score I 

* which life, 

well, brightest, richest, the, nice, 1 ^^ ... 

loveliest, strongest, healthiest, more, J ' 

Score o 

good, poor, .... ** life, 

42. The best advice usually obtained ^ 

one's parents. 

Score 2 

(may, can, will,)* be from, 

I directly, that, correctly, freely, 
easily, readily, promptly, first, 
fully, soon, accurately, properly, 
has, .... been .... from, 
Score I 

might, could, would, should, be from, 

*. . . . be of, by, through, 

rightly, well, best, only, 

is ' to be, better, willingly, 

fairly, cheerfully, 

is ** of, by, through, most, received, .... is ... . from, 

one has .... from, comes .... when .... from. 

Score 

is always, often, not, also, being, from, 

children have from, is best, to be, .... by. 



.... from. 



from, 
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51 things are satisfying to an ordinary 

than congenial friends. 

Score 2 

-. r man, person, child, mortal, \ * 

{ mdividual, boy, girl, woman, J 

Most less \ 

Scare i 

-. / friend, companion, stranger, 

few .... more . . . . s , . ^ 

{ people, acquaintance, 

Play .... more child, boy, girl. 

Many, Some, No, Good, Sometimes, 

These, More, Those, New, One's \ ,,,. more, less, . . . .* 

Queer, Such, Many, Ordinary, What, 

Score o 

Kind, All, The, Small, Often, Flattering, more ,..,\ 

Few more one, condition. 

Few .... not .... man, Many .... more .... f riend^ 

Many quite *, 

84 a rule one association friends. 

Score 2 

As ... . (enjoys, prefers, likes, desires, welcomes, seeks,)* with. 

Score I 

As . . . .* of. As ... . makes .... with, 

. / holds, keeps, cultivates, finds, \ . . . 

AS ....A. .• fl #.... wicn, Ola 

\ chooses, wishes, loves, gams, J 

Score o 

As ... . chooses .... and. 

As ... . keeps .... his. 

Although .... like of, 




LANGUAGE SCALE E 

73. I see you. Can you see ? 

Score 2 

me, 
Score I 

the cat, men, us, it, 
Score o 

I can, yes, 

75. Ice is cold, but fire is 

Score 2 

hot, warm, 
Score I 

good, not, red, burning. 
Score o 

how, burned, cold, 

7. The kind lady the poor man a dollar. 

Score 2 

gave, gives, o£Fers, offered, i>aid, pays, took, sent, loaned, lent, 

handed, tendered, 
Score I 

found, lends, loans, hands, sends, takes, give, is giving. 
Score o 

finds, helps, owes, owed, 

18. The best to sleep is at night. 

Score 2 

time. 
Score I 

hour, way. 
Score o 

place, bed, air, girl, boy, of all, go, thing, when, thing is, 

58. Children should many lessons from 

parents. 

Score 2 

(learn, take, receive, obtain, get,)*. . . . their. 
Score I 

study, have, observe, know, .... their, 

obey from, 

* the. 

Score o 

show, do, recite, from, have your, 
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25. The child the river was drowned. 

Score 2 

fell in, into, and, 

went, sprang, \ . ^ . 

, • « r • • • • into .... and, 
jumped, waded, j 

Score I 

swam, bathed, played, was, in and. 



went 



/ to, down, on, \ , 

^ near, m, J 



ran .... to, into, .... and, played, sat, .... near .... and, 
who crossed yesterday, who fell into .... soon, 

{, . , was .... at, on, .... and, 
ha W P^y*°8^ ^'^^^ accidentally. 

Score o 

went .... by .... and, was .... to, by, .... and, 

played .... at and, goes to and, 

swam .... through and, playing by today, nearly, 

34. It is a task to be kind to every beggar 

for money. 

Scare 2 

hard, burdensome, 1 

difficult, great, big, r *• • • (who, that,)**. . . (asks, begs, pleads,)*** 

real, trying, J 

Score I 

philanthropic, charitable, heavy, 1 

bitter, noble, small, foolish, pleasant, [ ** ***, 

good, little, bad, kind, worthy, mean, j 

* ** calls, cries, comes, seeks, wants, looks, wishes, works, 

* when asked, he asks, * asking one, 

• • • • ^W AAJI^aA • • • • • 

Score o 

daily, poor, fine, nice, friendly, easy, ** ***, 

* which ....calls, cries, comes, etc. * **.... needs, 

polite here asking, good that comes, 

36 . Worry never improved a situation but has 

made conditions 

Score 2 

I often, usually, always, generally, merely, 
undoubtedly, sometimes, only, certainly, ^ * . . worse, 
slowly, probably, simply, repeatedly surely, 
certainly, surely, * worse, 
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has .... 



Scare z 

{rather, really, ever, mostly, even, 1 
instead, just, indeed, helped, J ' 

has *. . . . serious, poor, change, poorer, bad, harder, miserable, 

has .... always, gradually, serious, poor, etc. 

Score o 

has .... never worse, will often .... worse, 

has .... never, often, better, should often worse, 

never .... often worse, can sometimes worse, 

52. When one feels drowsy and , it happens 

that he is to fix his attention very successfully 

anything. 



Scare 2 

dull, tired, stupid, weary, 
fatigued, lazy, indolent, 
sleepy, inattentive, ill, 
inert, indisposed, sick. 



f usually, always, 
generally, 
frequently. 



*« 



sometimes, often, J 

unable \ * } 

I upon, J 

* (seldom, rarely, never,) •J* able ***, 



*** 



Score z 



weak, sad, bored, cross, is, tired, . 

a... ^ .... aOlC . • . • 10, OL, 



** unable 

♦♦♦....able 



«** 



I 



invariably, soon, just, then, so, unable. . . .♦♦*, 

^* failing, able, slow, unfit, not able, too tired, unfit, . 

*** trying, going, ready, liable, apt, ***, 



*«# 



lazy .... never apt on, 

Score o 

* ** niever ♦♦♦, sick generally. . . .made **♦, 

sleepy .... often not ♦♦♦, 

tired sometimes lazy on, 

83. In order clearly at it is ^ 

to artificial 

Score 2 



. . f use (light,! 

to... see. .mght. . .necessary. ..< . r ht 



means, devices,)* 



Score z 



to see /times, \ [necessary,! have. use ♦ 

I times I J use I 

to. . .think. • • S 11 ( .. .necessary. ., i 'HI' -stimulants. 
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zn . . Wife . i«^ 

t*> . . . 

to ... . 



to 



to 9tt . . . 

S€m€0 

to flee 

to ' . . . ABC . . , , once . . • . best .... try 

to .... }ooiL .... gomgtnon .... aoTHabie .... icjuuve .... sidsp 

to ... . think . . . twiiff 



LANGUAGE SCALE J 

29. Boys and soon become and women. 

Score 2 

girls .... men, 
Score I 

girls, girl man, girls gentlemen, 

Score o 

girl .... mans, men .... poor, 

61. The are often more contented the rich. 

Score 2 

poor than. 

Score I 

poor, people, with, by, children, people, than, 

girls with. 

Score o 

girls, men, parents, than, 

64. The rose is a favorite because of fragrance 

and 

Score 2 

flower .... its beauty, color, 

Score I 

flower .... the .... beauty, color, smell, blossoms, sweetness, 

flower its scent, smell, appearance, sweetness, blossoms, 

Score o 

flower sweet, nice, looks, pretty, 

41. It is very to become acquainted 

persons who timid. 

Score 2 

(harf. difficult.)*. . . . f 7f- t;7"8Uy. fuUy. \ „ ^^ 

\ mtimately, personally, J ' 

Score I 

trying, tiresome, pleasant, possible, nice, 

unusual, awkward, unpleasant, annoying, 

fine, strange, uncommon, inconvenient, 

kind, easy, grand, good, sensible, 

troublesome, necessary, commendable, 

(really^ slightly, merely, closely, properly, 1 
rapidly, fairly, nicely, quite, familiarly, \ . .with, .are, 
readily, quickly, better, much, more, so, J 
• •• with seem, act, appear, look, 

95 



•*. . .with. . .arc, 



96 



Completion-Test Language Scales 



Score o 

nice much .... with are, 

well, unwise, customary, wrong, bad, . . . 
^ f good, goodly, kindly, easily, \ 

\ strongly, real, immediately, J 



• . • • wrlUl • • • . cuC, 

. . . with .... are, 



93. Extremely old sometimes almost as 



care as 



people 1 ^ 
persons J 



Score 2 

need, 

take, I ♦*...much... - 

require, 

Score I 

* are much, great, *•*, 

age brings much youth, 

age .... seems much sickness, 

men take .... much women, 

books need much new, 

people have, show .... little .... young, 

Score o 

things ** much trouble. 



babies, 

infants, young, 
^ children, invalids, ^ 



«•* 



87. One's in life upon so factors 

it is not to state any single for 

failure. 



Score 2 



easy, 



success 



{^^ *>*... .many. . . .that \ safe, 
rests, J I . 

* ^ \ wise, 

rule avoiding. 



** 



cause. 



Score I 

position, conduct, 
course, status, 
purpose, aim, 



{his, her, one's, 
every, any, a, 



* many that 

*• rule avoiding, 



reason, 

success * many that ** \ conditon, 

factor, 
one's 

our, complete, 
Score o 

success * many that true reason. . .our. 



( 
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89. The future of the stars and the facts of 

history are now once for all, I like them 

not. 



i6 

:our8e, destiny, \ -, f ancient, \ ** i- j i_ ^1. 

^. "^ > ♦ < ^ 1. . ) • .fixed, .whether. . .or, 

nrcuits, paths, j ^ past, their, J 



Score 2 
course, 
circuits, 

Scort I 

*....*• known, learned, settled, whether .... or, 

• future fixed whether .... or. 

Score o 

* ** fixed, known, and, although, them. 



LANGUAGE SCALE K 

i6. The boy will his hand if plays with fire. 

Score 2 

burn .... he, 
Score I 

injure, hurt, heat, warm, ruin, dirty, .... he. 
Score o 

use, shake, hold, lose, suck, wash, he, 

57. Hot weather comes in the and weather 

the winter. 

Score 2 

summer .... (cold, snowy, icy,)* in, 

summer .... cool precedes, 

Score I 

summer, spring, the, bad, rainy, .... in, 

spring *. . . in, brings, 

Score o 

summer *. . . . comes, 

28. The poor little has nothing to ; 

he is hungry. 

Score 2 
boy, 
fellow. 

Score I 

• got, received, almost, really, simply, even, probably eat, 

baby, creature, man, beggar, thing, pig, dog, bird,. ...**... .eat, 
• eaten day, •,baby, creature, etc eat. 

Score o 



* h'ld ^* I * * * ^^^' found, absolutely,)** eat, 



««.• •••• Qw, vfCSLXf 



j no, not, hardly, \ 
{ never, entirely, J 



33. Very few people how to spend time and 

to the best advantage. 

Score 2 

(know, learn,)* (money, energy, eflFort,)** 

Score z 

* thought, study, work, think, put it, knows **, 

find, show, ....**, 
Score o 

find work, think, *. . . . go, send, try, do, 
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82. One not, as a , 

uninteresting things. 

Score 2 

(can, docs, will,)* rule, fact, (give, pay,)** to, 

*,8hould, rule ** to, *. . . .child. ...**... .to, 

* rule attract, call, direct, to. 

Score I 

* rule, **, fix, put, hold, on, 

place in. 



attention 



student, teacher, 

* ' necessity, 

reader, practice, 

has rule much . . 

should idiot, practice. 

Score o 

* spectator keep . 



** to 

maintain with, 

hold .... by, 
for, 
** to 

. to. 



looks .... tarter giving to, 

90. To eat one is is a pleasure. 

Score 2 

(when, whenever,)* hungry (great, real,)** 

(till, until,)***. . . . satisfied. ...**, 

Score I 

* well, happy, **, food, what, fond of **, 

♦♦* full, stuffed, **, heartily told, convinced, **, 

what, whatever, forbidden, given, doubtful, **, 

Score o 

delicious sure **, when enjoying marked. 



V*...or...f^^^'l**.. 
\ ways, J 



86 they us not, nature's 

are and unchangeable. 

Score 2 

suit, affect, 

Whether. . . < impress, concern, 

favor, disturb. 
Score I 

Whether convince, effect, or ** fixed. 

If * or ** fixed. 

Whether influence or ** true, inflexible. 

Score o 

Even suit .... or ... .roads sure. 



.fixed. 



LANGUAGE SCALE L 
60. Children are rude not easily win friends. 

Scare 2 

(who, that,)* (do, can, will,)** 

Score I 

• may, should, must, which **, 

Score o 

may be but, 

66. Plenty exercise and air healthy 

and girls. 

Score 2 

of (fresh, pure, good,)* makes boys. 

Score I 

of * make boys, 

of clear, plenty of, .... makes boys, 

outdoor, work, study, * makes boys, 

of *. . . . is to boys, for boys. 

Score o 

of healthy give boys, 

70. In to maintain health, one should have 

nourishing 

Score 2 

order (one's, his, good,)* (food, foods,)** 

Score I 

seeking, trying, helping, traveling, \ ♦ ♦♦ 

summer, winter, spring, truth, illness, J ' 

order our, your, ** 

Score o 

life ....*....**, time ....*....**, 



rue, Real, Great, Your, Our, \ ^ al t.^ j \ 

[is. Her, One's, ChUdren's, / ' ' * ' *^"«^*' compared,) 



65 happiness can not be with money. 

Score 2 

True 

His, 
Score I 

Some, Plenty, No, People's, \ f **, gotten, secured. 

Often, All, Much, j \ obtained, 

*, Much, Always, Sometimes, < ^ .' . ' , ' 

^ won, insured, made. 

Score o 

Good made. Your counted. Their repaid, 
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- % « • 
< • • • 



••/-.•• 



^ f somewhere, out, \ ^^ . 
\ away, home, J " 
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• • J*. 
32. One's do always express his thoughts'./* -/•, 

Score 2 •' : 

(words, statements,)* not. 

Scare i 

expressions, looks, actions, sayings, features, word, lips, not» 

words .... almost, actions nearly, most. 

Score o 

ways, eyes, opinions, not, expressions nearly, 

92. To to wait, after having to go , 

very annoying. 

Score 2 

{prepared, planned, 
decided, promised, 
arranged, hurried, 

have * promptly .... is, have .... asked ...**.. .is. 

Score I 

nave .... ^^aiceci .... .... is, 

stop attempted ** is, 

have *, wanted, wished, had, is sometimes, often, 

have lunch swimming is, 

have had quickly, far, is, 

have somewhere, far, . . . .often, have. . . .had. . .away. . .is. 

Score o 

have preparing there .... is, 

have had .... work is, 

78. It is sometimes to between two 

of action. 
Score 2 

(difficult, hard,)* choose (lines, modes, courses,)** 

necessary hesitate **, 

Score I 

*, necessary, .... choose, distinguish, kinds, types, 

dangerous go .... men. 

Score o 

safe go .... guns, 

97. One can do his at one while 

of another. 

Score 2 

not, \ ^ J best, 

never. 
Score I 

* ** time, place, .... thinking, dreaming, 

often ** ***, time, place, thinking. 

Score o 

also **.... time .... not, *....**.... time .... seeing, 

easily .... work .... time .... talking, 



t, U /best. U.r thing, task, job \ ... ^u^ 
/tr, J ^ duty, J \ occupation, study, J *' 



Appendix 103 

79. Nothing can one's happiness effectively 

than a guilty 



Score 2 



destroy, injure, mar, lessen, 1 

g • • • • . 



J . ., > more conscience, 

decrease, rum, spoil, J 

Score I 

harm, hurt, hinder, dampen, effect, darken,. . .more. . .conscience, 

Score o 

stunt, hinder, more man, person, 

45. To many things ever finishing any of 

them a habit. 

Score 2 

begin, undertake, 1 

attempt, leave L ^^hout ( jl |**..bad. 

commence, start, \ becomes, J 

try, plan, J 

Score I 

take, have, do, make, say, \ .^u ^ ** l j 

-. , ' ., > without •• bad, 

stop, think, get, avoid, j 

• hardly, before, not, n, never, ** bad, 

* without ** deplorable, pernicious, tenacious, strange, 

*. . . .without. . . .forms, seems, starts,. . . .bad, 

Score o 

take, have, do, make, before, not, ** bad, 

take, have, etc without seems, starts, forms, bad, 

do. . . .when. ...**... .bad, *. . . .and. ...**... .bad, 

91. The seems and dreary a dis- 
couraged 

Score 2 

man, woman, ] •♦• 

(world, day,)*. . . (dull, dark, sad,)**. . . to. . . ^L^ ' 

I boy, girl, 
road long to. . . .traveler. 

Score I 

way, time, road, long to. . . . ***, voyager, 

teacher, man, boy sad and, over, ***, mortal, 

man tired after attempt, * ** when. . . .***, 

* •* for ***, * *• giving feeling. 

Score o 

* long although ***, 

8 



.• *- 



1 



LANGUAGE SCALE M 
67. One can not foretell will happen in the 

Score 2 

, f future, morning, autumn, winter, \ ^ 

\ mght, end, spring, summer, J 

Score 1 

. f city, crowd, present, family, house, 

* * ■ * \ month, year, morrow, day, world, 

things that *, 

Score o 

what time, past, today, that *, 

59. The dog a useful because his 

intelligence and faithfulness. 

Score 2 

is. . . . (animal, creature, friend, pet, beast, companion,)*. . . .of. 
Score 1 

is ... . fellow, thing, being, dog, of, 

becomes *....of, is * he has, 

Score o 

is * by, has .... manner .... of, 

95. Many people their health because do not 

the of hygiene. 

Score 2 

lose, injure, ruin, \ « {.u / observe, heed, understand, \ 
undermine, destroy, J * \ know,practice, follow, keep, f *** 

f principles, \ ••* 

\ laws, rules, J * 

keep they neglect *J* 

* they know need, good, value, meaning. 

Score I 

wreck, mar, haven't, spoil, waste, they *** •J* 

• thev atudv / 8C»ence, subjects, books, 

\ lessons, study, rules, 

have they disregard. .. .study, subject, science, 

Score o 

protect .... they .... want .... disease, 

lose they acquire .... value, 

have they follow •J*, ethics, 
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79. Nothing can one's happiness effectively 

than a guilty 

Score 2 

'•1 

decrease, ruin, spoil, J 

Score I 

harm, hurt, hinder, dampen, effect, darken,. . .more. . .conscience, 

Score o 

stunt, hinder, more man, person, 

45. To many things ever finishing any of 

them a habit. 

Score 2 

begin, undertake, 1 

attempt, leave , ^t,,out ( j^ |**..bad. 

commence, start, \ becomes, J 

try, plan. 

Score I 
take, 
stop, 

* hardly, before, not, n, never, ** bad, 

* without ** deplorable, pernicious, tenacious, strange, 

*. . . .without. . . .forms, seems, starts,. . . .bad. 

Score o 

take, have, do, make, before, not, ** bad, 

take, have, etc without. . . .seems, starts, forms, bad, 

do. . . .when. . . .**. . . .bad, *. . . .and. **. . . .bad, 

91. The seems and dreary a dis- 
couraged 

Score 2 



;, have, do, make, say, \ -^u ^ ** u j 

* ,. ,* * .* ^ ) without ♦♦ bad, 

>, think, get, avoid, J 



(world, day,)*. . . (dull, dark, sad,)**. . .to. . . 



man, woman, ■ •** 



person, 
child, 
, boy, girl. 



road. . . .long. . . .to traveler, 

Score I 

way, time, road, long to. . . . ***, voyager, 

teacher, man, boy sad and, over, ***, mortal, 

man tired after attempt, * ** when. . . .•**, 

* ** for ***, * ** giving feeling. 

Score o 

* long although ***, 

8 
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Completion-Teat Language SaUea 



55 that are to one by an 

friend should be pardoned readily than injuries 

done by one is not angry. 

Score 2 



Injuries done. 



angry 
angered 



1 • T ^' 1 

irate, 
[ enraged, 



. . . niofe .... 



/ who, 1 
I that,/ 



** 



Injuries. ..done. . . 



.more. . .**, 



*« 



Score I 

Injuries .... done * more .... which, 

Injuries .... given, rendered, * more ....**, 

Injuries done * less **, 

irritated, incensed, old, 
another, injured, intimate, 
other, honest, innocent, 
ordinary, unkind, 
Insults, Harms, ] 

Wrongs, Slights, t done * more 

Offences, Things, j 

Words. . . .spoken irritated. . . .more **, 

Score o 

Things done unknown. . . .more **, 

Injuries done * very **, 



88. It is that a full-grown man should a 

ghost he is 

Score 2 



inconceivable, 
improbable, 
impossible, 
unbelievable, 



, fwhile, \ 

\ when, if, J 



*• 



*** 



sane, 
sober, 
awake, 
unless, except, .... insane, drunk, 

absurd, strange, fear ** ***, 

Score I 

best. . . .show that unafraid, said fear if. .wise, 

foolish fear. . . .since grown, strange. . . .see. .**. .***, 

unwise become before, until, dead, 

* believe story reading, * be **. . . .dead, 

Score o 

strange know when alone. 



OTHER SENTENCES USED IN THIS STUDY 

3. I see man and the boy. 

Score 2 

the, 
Score I 

a, some, that, one, our, your, my, both the, the big. 
Score o 

big, this, 

9. Here is a man who do it. 

Score 2 

can, could, couldn't, can't, will, would, wouldn't, won't, may, • 

cannot, might, should, shouldn't, does, must, doesn't. 
Score I 

did, shall, does not, likes to, ought to, saw him, dared to, 
Score o 

dared^ never, always, will try to, 

10. The bird a song every morning. 

Score 2 

sings, sang, sung. 
Score I 

will sing, sing, has, warbles, chirps, pipes, sings us, gives, gives us. 
Score o 

likes, did, songs, song, 

13. Boys must be rude to mothers. 

Score 2 

(not, never, )• their. 

Score I 

* good, dear, any, our, your, the. 

Score o 

* his, her, seldom, always, .... their, 

14. When the ^ grows older he be a man. 

Score 2 

(boy, youth, lad,)* will. 

Score I 

^ ( may, must, can, shall, should, could, would, 

\ might, has to, is to, begins to, comes to, 

child, son, baby, brother, man, boys, .... will, 
Score o 
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154 The stars brightly at 

Score 2 

(shine, shone, gleam, twinkle,)* night. 

Score I 

^ ( midnight, evening, seven, last, us, me, 

\ you, him, home, 7:30, 8 o'clock, 

shines, appear, look, show, epaMe, \ ._. ^ 

• . . / . . . . nignt, 

come out, were shining, J — » -^ 

Score o 

shining, are, night, * the sky, the town, dty, 

17. The wind the dust into our eyes. 

Score 2 

blows, blew, blowed, sweeps, swept. 
Score I 

throws, carried, gets, sends, chases, carries, raises, brings, puts, 

threw, got, brought, sent, chased, raised, will blow, put, is blowing. 
Score o 

draws, makes, has, flew, 

20. The little and his dog running a race. 

Score 2 

(boy, fellow, lad,)* (are, were, b^;an,)** 

Score I 

* came, went, kept, try, play, like, won, was, is, 

child, master, man, **, came, went, etc. 

Score o 

•* cat •* • had 



a6. Boys who play mud get their hands 



Score 2 

in the (dirty, soiled, muddy,)** 

Score I 

in the black, wet, sticky, filthy, nasty, 

in, around, wet, dirty, soft, black, any, with, near, **, 

marbles, games, ball, in, with, **, 

with dirt, in dirt, and **, at moulding ** 

Score o 

in, with, . . ; . dirty, soft, dusty, , much, in **, 

39. If a person injures one by , without having intended 

any , one should insulted. 

Score 2 

(injury, offence, 
harm, disrespect, ^ ** 
insult, affront, 

f not, 1 ^^^ / be, feel, \ «•« 
\ never, J \ become, J * 



accident, chance, 

carelessn 

thoughtli 
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Score I 

mistake, words, remarks, talking, gossip, 
fooling, unthoughtfulness, mishap, talk, 
speaking, fun, ignorance, anything, word, 
speech, something, haughtiness, shoving, 
pushing, hitting, joking, jokes. 



• •■• •••• 



** 



• • • • • 



accident accident. . . .*** ***, 

^ f wrong, thing, unkindness, hurt, 1 •*• *J*, 

\ mischief, malice, mishap, trouble, / 
Score o 

slander, insulting, snubbing, shooting, slapping, ,..**,..***,., 



40. A shelter the weather is appreciated on a 

day. 

Score a 

greatly, thoroughly, 
fully, heartily, duly, 
certainly, usually, 
highly, always, 
generally, truly, 
indeed, much, keenly. 



from. 



I stormy, rainy, 
snowy, wintry, \ *♦ 
cold, bad, hot. 



** 



from rarely, not, seldom, pleasant, beautiful, bright, 

Score I 

only, surely, best, well, sincerely, 
from ' most, fairly, quite, kindly, more, 

better, often, to be, deeply, 
from * damp, summer, wet, warm, against 

f^^«, «^«. / P^^^f summer, sunny, warm, 

irom .... not . . . . s , , . /. 

(^ good, clear, mce, fine. 

Score o 

from .... very, good, glad, not, ....**, to, in, for, of,. ...*.... ^^i 



*• 



43. A home is merely a place one .... 

live comfortably. 
Score 2 

(not, often, sometimes,)* where (may, can,)** 

Score I 

* in which, that, **, will, would, should, 

generally, usually, just, \ ^^^^ ^» 

never, / ' 



now, really, now 

*, generallyi usually, etc for to, *. 

Score o 

• where does, * for who, 

but, only, always, .... where **, 



so ** 



LANGUAGE SCALE K 

1 6. The boy will his hand if plays with fire. 

Score 2 

burn .... he. 
Score I 

injure, hurt, heat, warm, ruin, dirty, .... he, 
Score o 

use, shake, hold, lose, suck, wash, he, 

57. Hot weather comes in the and weather 

the winter. 

Score 2 

summer (cold, snowy, icy,)* in, 

summer .... cool precedes, 

Score I 

summer, spring, the, bad, rainy, in, 

spring *. . . in, brings. 

Score o 

summer *. . . . comes, 

28. The poor little has nothing to ; 

he is hungry. 

Score 2 
boy, 
fellow. 

Score I 

* got, received, almost, really, simply, even, probably. . . .eat, 

baby, creature, man, beggar, thing, pig, dog, bird, ** eat, 

* eaten day, *fbaby, creature, etc _ eat. 

Score o 



* h'lH I • • • (^^» found, absolutely,)** eat. 



.••• •••• U>/, vfCSUf 



( no, not, hardly, \ 
\ never, entupely, J 



33. Very few people how to spend time and 

to the best advantage. 

Score 2 

(know, learn,)* (money, energy, effort,)** 

Score I 

* thought, study, work, think, put it, knows **, 

find, show, **, 

Score o 

find work, think, * go, send, try, do, 
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82. One not, as a , attention 

uninteresting things. 

Score 2 

(can, does, will,)* rule, fact, (give, pay,)** to, 

*,8hould, rule ** to, * child ** to, 

* rule attract, call, direct, to. 

Score I 

* rule, **f fix, put, hold, on, 

place in. 



** to 

maintain with, 

^ hold by. 



student, teacher, 
necessity, 
reader, practice, 

has rule .... much .... for, 

should .... idiot, practice, ....**.... to, 
Score o 

* spectator keep .... to, 

looks .... tarter giving .... to, 

90. To eat one is is a pleasure. 

Score 2 

(when, whenever,)* hungry (great, real,)** 

(till, until,)***. . . . satisfied. ...**, 

Score I 

* well, happy, **, food, what, fond of **, 

*** full, stuffed, **, heartily told, convinced, **, 

what, whatever, forbidden, given, doubtful, **, 

Score o 

delicious sure. ...**, when .... enjoying .... marked, 

86 they us not, nature's 

are and unchangeable. 

Score 2 

suit, affect, 1 f 1 1 

Whether. . . \ impress, concern, \ *. . .or. . . { ' f *• • -fi^^d, 



t 



favor, disturb, j I /» 

Score I 

Whether .... convince, effect, or ** fixed. 

If * or ** fixed. 

Whether influence or ** true, inflexible. 

Score o 

Even suit or ... .roads sure. 



LANGUAGE SCALE L 

60. Children are rude not easily win friends. 

Score 2 

(who, that,)* (do, can, will,)** 

Score I 

* may, should, must, which ....**, 

Score o 

may be ... . but, 

66. Plenty exercise and air healthy 

and girls. 

Score 2 

of (fresh, pure, good,)*. . . . makes boys, 

Score I 

of * make boys, 

of clear, plenty of, makes boys, 

outdoor, work, study, * makes .... boys, 

of * is to boys, for boys, 

Score o 

of healthy .... give .... boys, 

70. In to maintain health, one should have 

nourishing 

Score 2 

order (one's, his, good,)* (food, foods,)** 

Score I 

seeking, trying, helping, traveling, 1 ^ 

summer, winter, spring, truth, illness, J 

order .... our, your, ....** 
Score o 

life....*....**, time ....*....**, 

65 happiness can not be with money. 

Score 2 

True, Real, Great, Your, Our, \ , n^„„u-. ^^^^.^ \«« 

His, Her, One's, Children's, ] "" ^"«^^' ^^^'"P^'^') 

Score I 

Some, Plenty, No, People's, \ f **, gotten, secured. 

Often, All, Much, J \ obtained, 

I firotten secuT^ed had 

*, Much, Always, Sometimes, \^ ,* , ',* 

^ won, insured, made. 

Score o 

Good made. Your .... counted. Their .... repaid, 

100 
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32. One's do always express his thoughts'/* -.--^ 

Score 2 • : 

(words, statements,)* not, 

Score I 

expressions, looks, actions, sayings, features, word, lips, not» 

words almost, actions nearly, most. 

Score o 

ways, eyes, opinions, not, expressions nearly, 

92. To to wait, after having to go , 

very annoying. 

Score 2 

f prepared, planned, ] , somewhere out 1 

have { decided, promised, >* \ . f • •*•• 

[ arranged, hurried, J \ y^ » J 

have • promptly .... is, have .... asked ...**.. .is» 

Score I 

nave . . . • wraiLeu .... .... is, 

stop attempted ** is, 

have *, wanted, wished, had,. . . .is sometimes, often, 

have lunch swimming. . . .is, 

have had quickly, far, is, 

have somewhere, far, . . . .often, have. . . .had. . .away. . .is. 

Score o 

have preparing there .... is, 

have had . . . .work is, 

78. It is sometimes to between two 

of action. 
Score 2 

(difficult, hard,)* choose (lines, modes, courses,)** 

necessary hesitate **, 

Score I 

*, necessary, choose, distinguish, kinds, types, 

dangerous go men, 

Score o 

safe .... go .... guns, 

97. One can do his at one while 

of another. 

Score 2 

"''*• I •• • f ^ 1 ••• • • f *""^' ^^"'^ i^**;. 1 ••♦. thinking, 
never, J ^ duty, J ( occupation, study, J 

Score I 

* ** time, place, thinking, dreaming, 

often ** ***, time, place, thinking, 

Score o 

also ** time .... not, *....**.... time .... seeing^ 

easily work .... time talking, 



112 Campletum^Tegt Language Scales 

Score I 

I subdue, overcome, crush, calm, change, cure, 
conquer, push, prevent, guard, hide, stop, 
consider, conceal, 

is bring, take, set to *, 

is bring to overcome, subdue. 

Scare o 

IS ... . set .... to .... maintain, 
is ... . bring .... to .... conceal, 
IS ... . try .... and .... stop, 



96 ^ want are often caused by 

Score 2 

o ^ . f drink, ignorance, larincas, \ * 

roverty .... and . . . . \ . , ,. _• _. r 

\ sKrkness, disease, neglect J 

Score I 

Times of famine, 

^ '^■PCO • • • • \Mm • • • • • 

Things. . .people. . .selfishness, jealousy, indulgence, imagination, 

Need and pleasure, 

People in *, 

What girls variety, 

Score o 

Health and laziness, Horrors of obstinacy. 

Hunger and cries. Conditions in neglect, 

98. Children to pick 

Score 2 

like (flowers, berries, apples, fruit, daisies)* 

Score I 

come, are, came, are not, go, likes, \ ^ 

went, try, were, wish, have, ought j ' 

climb, jump, apples, like flower, nuts, 

try quarreb, playmates. 

Score o 

go stick, 

99. All animals shelter during a 

Score 2 

(seek, hunt, like, want, need, require,)* storm, 

* . . . . shower, rain. 
Score I 

find, have, take, get, love, look for night, shower, rain, 

* winter, need day. 

Score o 

are, will, do storm, have, shall year, day, summer, 
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100. Sympathetic are to dumb 

Score 2 

people, boys, ] 

men, girls, women, [ *• • • (kind, good)** . . . (animab, persons)*** 

persons, children, J 
Score I 

* ** ones, friends, pats pleasant animals, 

characters, friends, ** ***, signs best persons, 

persons sympathetic ***, 

words .... kind, nothing, animals, 

feelings, hearts, .... shown ***, 

Score o 

things, actions ** ***, people often animals, 

children not to learn, forms used people, 

always good people, 

loi. A boy run than a 

Score 2 

can, will, may)* (further, better, faster)** (baby, girl)*** 

can .... more .... mile, 
Score I 

cannot faster horse, 

likes to better, more, girl, man, 

could, should, ** ***, should, has, can't, . . . more . . . mile, 

*, could, should, quicker, sooner, more, swifter, ***, 

can faster snail, cat, rat, dog, always. . .faster. . .girl, 

can, would, rather, sooner, oftener, girl, 

will, can, should ** man. 

Score o 

can fast man, took and . . . jump, 

who . . . more mile, 

102. A drink is very refreshing to a who is 



Score 2 



cold, 
cool, 
good, 
fresh 



** 



person, laborer, ] 

men, runner, J 

woman, girl, 

child, tramp, 

boy, workmen. 
Score I 

healthy, soft, common, little, fine, water, 
beer, whiskey, soda, 5 cent, clean, 

* man, girl, boy healthy, well, here, running, 

• doff *** 

• • • • \j\^ j^ • • • • • 

little, small boy . . . .***, * **. .-. . dry. 

Score o 

fine .... man .... good. 



thirsty, hot, ill, 
tired, working, 
sick, traveling, | 
exhausted, warm, j 

W » m m 9 •••■ A 



mm* 
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103. A joke one's self is seldom thoroughly 

Score 2 

(on, upon, about)* appreciated, enjoyed, 

Score I 

^ f pleasant, told, seen, played, known, reasonable, good, 

\ funny, explained, expressed, kept, likes, 
to, with funny, by amusing. 

Score o 

about queer, in, of finished, with, in true, good» 

104. One feels inclined to work it is 

Score 2 

(little, less)* (when, if,)** (hot, warm)*** 

much, more, ....**.... cold, cool, 

Score I 

* after dark, * *• winter, nice, 

very ** interesting, 

dis, not, ] 

seldom, \ .... while, **, hot, 

himself, J 

seldom, really, rather, **.... necessary, 

himself, 1 ** ^. . ^ ^ often ** raining, 

, ' y ...**.. . tune, important, ^ . u -j 

much, J t f f jj^^ £jjj. hard, 

well *• easy, much . . . though . . .hard. 

Score o 

so, too, very, almost, it, when hot, day, 

105. Brothers sisters should always to help 

other. 

Score 2 

. f try, offer, strive, aim, endeavor, learn, seek, 1 ^ , 

* ' * \ consent, want, attempt, wish, like, agree, J * 

Score I 

and have, go, hurry, stay, love, work, be ready, come, . . .each, 

and . . . .* one, an, the, one, some, one an, 

and .... ask .... each, 

Score o 

and *. . . . out, along, and agree .... an, 

and go the, and glad .... each, 

106. Birds have which enable them to through 

the 

Score 2 

^ f air, woods, streets, sky, 1 « 

g y ^ clouds, country, meadows, J 
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Score I 

wing8 go *, wind, world, food eat winter, 

wing, foods, fly *, nests sleep, rest, night, 

beaks pick summer, feathers .... fly *, 

power fly *, feathers live winter, cold, 

wings, fly place. 

Score o 

instincts, trees live year, that go air, 

incense wander world, homes fly winter, 



107 the weather is .. 

than when it is 

Score 2 



(When, If)*. . (cold, cool)**. . 



one should wear heavier 



clothing, clothes, 
garments, cloaks, 
coats, wraps, 
underwear. 



*•« 



[hot. |.« 
[warm, J * 



Score I 



*•* 



warmer, good, nice, 



* stormy *** nice, hot, 

cold when *** ***, 



* winter *** summer, * bad *** ***, 

Although ** ♦** ♦J*, As, Now,. ..*♦.. .clothes. . .*J*, 



Score o 

How . . 
Like . . 



. . no *** cold, 

I . looay .... ' ' ' ' ^ t ^ no .... wariu .... .... ^ 



Here, Sometimes ** *** ***, 



108. One cannot his thoroughly he 

has good teeth. 

Score 2 

(chew, masticate, grind, bite)* food .... (unless, until)**, 

Score I 

eat food, meals, supper **, do ... . work ....**, 

have health unless, spoil looks when, if, 

* food without, maintain .... health unless, 

Score o 

eat, chew, food when, if, because, though, 

clean teeth .... when, keep teeth clean, unlets, 

have .... way till. 



3. CALCULATION OF MEDIAN SCORE IN LANGUAGE SCALES 

Each child who spends the allotted amount of time in an attempt to complete 
the sentences of any of the language scales described in this study should be 
given as a total score the sum of the number of points made upon the individual 
sentences contained in the scale. For example, the child who completes 
perfectly the first three sentences of Scale B, and almost perfectly the fourth 
sentence in this scale, should be given a total score of seven points on Scale B. 

(2+2+2+1=7.) 
To find the ability of the class, it will be necessary to take into consideration 

the total score made by each child in the class. A distribution should therefore 

be prepared showing the scores made by the individual members of the class. 

This distribution should indicate the number of pupils in the class who make 

a score of zero, the number making a score of one, the number making a score 

of two, the number making a score of three, and so on for each step up to 

twenty, the highest possible score in Scales B to E. As examples of this sort of 

distribution, we may take the following: 

Nurnber of Times Each Score Was Made in Langfoage Scale C 
Score 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 



Group X 
Group Y 
Group Z 



3684322.1. 

..1.236643212 

22364.63421 



There are 28 individuals in Group X, 29 individuals in Group Y, and 
32 individuals in Group Z. The only adequate comparison of these three 
groups is such a table as that shown above, or a surface of distribution repre- 
senting the same facts. The average score, or even the median score, is in 
itself inadequate as a measure of the group, although it is usually desirable to 
calculate the median as an indication of the central tendency of the group's 
ability. 

The median of any distribution is that point on the scale which divides the 
distribution into two exactly equal parts. When the scales are very crude, 
and measurements of small numbers of individuals are being considered, it is 
not worth while to locate the median point any more accurately than by indi- 
cating upon what step of the scale it falls. In the case of carefully derived 
scales, however, it is often desirable, especially where the group to be measured 
is reasonably large, to locate the exact point within the step where the median 
falls. This median point in the case of the scales here presented may well be 
calculated to the tenth, or even to the hundredth of a unit, if 200 or more 
individuals are in the group being measured. 

Since there are 28 individuals in Group X of the distributions shown above, 
the median point will evidently fall between the fourteenth and the fifteenth 
individuals. If we begin with the three individuals making a score of 2, and 
116 
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count up through the five individuals making a score of 3, we should have 
to count out six of the eight individuals making a score of 4 in order to 
arrive at the point upon each side of which an equal number (14) of papers 
were scored. 

It now becomes necessary to define the fourth step. Some of those scored 
four may have been worth just barely 4 points, while others of this group 
may have been worth almost 5 points. It is impossible, of course, to know 
at just what points between these two extremes each of the eight individuals 
was located. The best single assumption to make, and the one which should 
always be made, is that those individuals scoring upon any single step of a 
scale are distributed along the step at equal distances from each other. We 
may therefore assume that the eight individuab scored upon step 4 range 
from 4.0 to 4.999 and lie at equal distances from each other along this range. 

If we count out six, therefore, of the eight individuals who scored on step 4, 
we shall arrive at a point which is approximately 4.7. 4.7 is therefore the 
median point of Group X. 

Similarly there are 29 individuals in Group Y. The middle case is the fifteenth 
individual, who is the fourth of the six scored on step 9. This individual has 
fourteen persons scored above him in ability and fourteen persons scored 
below him in ability. The median point, therefore, will lie at the middle of 
that fraction of the step assigned to him. In order to reach this point it will 
be necessary to count out three and a half of the six individuals scored on step 9, 
which brings us to 9.6, the median of Group Y. 

Group Z presents a peculiar problem in the calculation of its median. There 
are 16 individuals above score 14, and 16 individuals below score 14. Probably 
the wisest assumption to make is that the four individuals scored on 13 take up 
all of the thirteenth step and that the six individuals scored upon 15 take up 
all of that step. If this is assumed, the median falls upon step 14, probably 
at 14.5, since any given distance on a scale is best represented by its middle 
point. 

The 25 percentile and the 75 percentile are to be found in a manner similar 
to that for finding the median, counting into the distribution one-fourth of the 
total number of cases for the first, and three-fourths of the total number of 
cases for the second. 



4. TENTATIVE STANDARD SCORES IN LANGUAGE SCALES 

B, C, D, AND E 

The new scales proposed in this monograph have not as yet been employed 
upon a sufficiently large number of children in each grade to establish any 
definite standards of attainment. Although each sentence has been well tested 
in other combinations, the scores that will be obtained with the new scales can 
only be estimated. It seems worth while, however, especially for Scales B, 
C, D, and E, which will probably be employed somewhat more generally than 
the four special-type scales, to indicate in a general way what results may be 
expected in each school grade. The writer therefore gives below the best esti- 
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mate^ he is able to make of the median score that any given school grade should 
make on one of these four scales. 



Grade 


Medi 


II 


3.0 


III 


6.0 


IV 


8.0 


V 


9.6 


VI 


II. 


VII 


"3 


VIII 


13 3 


IX 


14.2 


X 


153 


XI 


15.8 


XII 


16.2 



The above tentative standards will not be found to be exact for any given 
scale, but until we have accurate results from a large number of applications 
of each scale in each grade, the above figures may be used as the best estimate 
available for any one of the four scales. On the whole it may be said that the 
above estimates are more likely to be too low than to be too high. One may 
also expect the same class or classes of equal ability to make a median score 
from .4 to .8 of a point lower in Scale C than in Scale B, while the median 
on either Scale D or Scale £ will probably fall between that obtained on 
Scale B and that obtained on Scale C. 

With a view to establishing more accurate standards of attainment, the 
writer will be pleased to receive copies of the results obtained by any investi- 
gator employing any of the scales proposed in this monograph. If anyone, 
having five hundred or more public school pupils to measure, is willing to 
codperate to the extent of reporting to the writer the score of each child on 
each sentence of the scale used, the writer will be glad to send him blanks for 
making such records and to refund 10 per cent of the purchase price of the 
scales (as purchased from the Teachers College Bureau of Publications) imme- 
diately upon receipt of such reports. 



1 In making this estimate it is of coarse assumed that anyone who wishes to compare their 
results with these figures will make the tests carefully as directed on pages ao to aa of this 
monograph, employing the blanks furnished by the Teachers College Bureau of Publications, 
and sooraig each sentence according to the scheme given in Section 2 of this Appendix. Any 
deviations from this procedure should not be made without making allowances ror differences 
in the remits. 
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